-- Logs begin at Tue 2021-05-18 01:03:58 UTC, end at Tue 2021-05-18 01:56:20 UTC. -- May 18 01:30:39.387455 dv-cinder-784623-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 01:30:39.395381 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 18 01:30:39 2021] *** May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: nodename: dv-cinder-784623-9-iscsi May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: machine: x86_64 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: clock source: unix May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: pcre jit disabled May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: detected number of CPU cores: 4 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: current working directory: / May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: detected binary path: /usr/bin/uwsgi-core May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: your processes number limit is 47680 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: your memory page size is 4096 bytes May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: detected max file descriptor number: 2048 May 18 01:30:39.398717 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: lock engine: pthread robust mutexes May 18 01:30:39.399497 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: thunder lock: enabled May 18 01:30:39.399497 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 01:30:39.399497 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 18 01:30:39.439359 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: Python main interpreter initialized at 0x55b1aee349c0 May 18 01:30:39.439359 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: python threads support enabled May 18 01:30:39.439359 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: your server socket listen backlog is limited to 100 connections May 18 01:30:39.439359 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: your mercy for graceful operations on workers is 90 seconds May 18 01:30:39.439711 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: mapped 403077 bytes (393 KB) for 2 cores May 18 01:30:39.439796 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: *** Operational MODE: preforking *** May 18 01:30:39.440039 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: *** uWSGI is running in multiple interpreter mode *** May 18 01:30:39.440039 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: spawned uWSGI master process (pid: 78176) May 18 01:30:39.440247 dv-cinder-784623-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 01:30:39.441240 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: spawned uWSGI worker 1 (pid: 78177, cores: 1) May 18 01:30:39.441240 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: spawned uWSGI worker 2 (pid: 78178, cores: 1) May 18 01:30:39.441395 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 01:30:41.046180 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:30:41.046180 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: from cryptography.utils import int_from_bytes May 18 01:30:41.046774 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:30:41.046774 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: from cryptography.utils import int_from_bytes May 18 01:30:41.050327 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:30:41.050327 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: from cryptography.utils import int_from_bytes May 18 01:30:41.050804 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:30:41.050804 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: from cryptography.utils import int_from_bytes May 18 01:30:43.617939 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 01:30:43.618573 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 01:30:43.618686 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 01:30:43.619057 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 01:30:43.619317 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 01:30:43.619710 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.620043 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.620401 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.620729 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.621066 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.621386 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.621713 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.622041 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.622376 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.622651 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.622975 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.623308 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-9-iscsi {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.623637 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.623951 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.624267 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.625139 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.625518 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.625855 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.626167 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.626673 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.627128 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.627446 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.627714 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 01:30:43.628090 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.628180 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 01:30:43.628266 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.628518 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.628615 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 01:30:43.628737 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.628924 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 01:30:43.629067 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.629189 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 01:30:43.629405 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.629582 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.629719 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.629916 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630049 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630273 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630384 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-9-iscsi {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630590 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630682 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.630908 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631020 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631225 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631410 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631590 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631778 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.631936 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.632157 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.632345 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.632496 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.632671 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.632849 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633068 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633252 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633444 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-9-iscsi {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633600 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633748 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.633896 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634033 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634195 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634318 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634470 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634601 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634723 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634853 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.634978 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635108 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635255 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635378 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635505 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635705 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.635858 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636017 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636114 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636346 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636465 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636607 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636691 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.636923 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637014 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637253 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637344 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637579 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637661 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637905 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.637999 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638162 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638246 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638416 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638536 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638741 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.638852 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639066 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639179 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-9-iscsi {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639381 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639500 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639695 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.639815 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.640007 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.640156 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.640913 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.641228 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.641543 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.641697 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.641846 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.641994 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642156 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642301 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642481 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642625 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642802 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.642969 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643136 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643280 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643451 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643595 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643778 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.643935 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644183 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644362 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644507 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644643 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644779 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.644925 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645079 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645225 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645408 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645553 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645724 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.645868 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646050 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646218 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646363 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646508 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646656 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646801 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.646945 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647093 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647318 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647464 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647611 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647749 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.647892 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648040 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648177 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648347 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648503 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648645 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648792 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.648936 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649083 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649231 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649374 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649512 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649649 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649785 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.649920 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650065 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650202 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650346 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650502 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650657 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650796 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.650941 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651079 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651214 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651379 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651522 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651703 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.651848 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652022 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652172 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652347 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652508 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652667 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652807 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.652950 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653093 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653237 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653374 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653565 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653710 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.653889 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654033 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654199 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654343 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654499 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654646 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654809 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.654953 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.655120 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.655273 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.655447 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.655602 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.655799 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656030 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656176 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656453 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656633 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656792 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.656949 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657089 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657282 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657509 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657662 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657807 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.657952 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658101 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658245 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658393 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658531 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658674 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658824 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.658972 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659111 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659267 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659406 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659543 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659679 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659814 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.659950 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660098 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660237 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660411 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660581 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660755 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.660905 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661056 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661196 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661333 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661476 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661615 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661790 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.661949 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662087 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662232 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662401 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662546 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662709 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662848 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.662990 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663135 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663322 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663474 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663650 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663796 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.663965 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.664110 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.664260 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.664437 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.664587 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.664737 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.664902 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.665056 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.665229 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.665373 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.665543 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.665689 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.665856 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.665999 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.666183 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.666327 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.666544 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.666684 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.666831 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.666967 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.667103 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.667248 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.667385 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.667546 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.667756 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.667906 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.668044 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.668188 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.668387 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.668543 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.668681 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.668836 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.668974 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.669124 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.669262 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.669398 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.669534 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.669715 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.669866 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.670036 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.670180 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.670361 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.670512 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.670699 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.670843 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.670995 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.671143 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.671303 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.671448 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.671761 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.672115 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.672270 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.672464 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.672609 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.672799 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.672943 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.673128 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.673273 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.673459 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.673602 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.673782 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.673925 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.674106 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.674272 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:30:43.674420 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.674558 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.674739 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.674892 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675062 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675216 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675383 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675528 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675726 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.675872 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676050 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676195 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676415 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676569 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676714 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.676859 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677011 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677156 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677311 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677449 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677592 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677756 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.677975 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678120 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678264 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678401 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678537 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678683 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678821 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.678957 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679162 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679307 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679477 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679630 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679797 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.679941 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680116 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680261 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680453 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680610 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680775 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.680942 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681089 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681239 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681398 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681551 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681727 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.681876 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682046 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682197 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682344 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682489 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682676 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682822 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.682999 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683144 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683302 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683440 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683622 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683765 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.683941 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684092 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684262 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684453 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684592 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684729 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.684920 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685062 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685239 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685394 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685554 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685696 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.685893 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686043 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686214 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686357 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686533 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686675 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.686845 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.687488 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.687760 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.687973 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.688201 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.688521 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.688670 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.688856 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689010 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689154 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689291 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689473 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689619 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689789 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.689934 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690111 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690270 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690428 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690581 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690803 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.690943 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691081 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691218 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691355 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691500 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691640 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691776 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.691954 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692100 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692273 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692473 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692620 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692757 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.692915 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693057 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693228 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693381 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693542 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693685 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.693873 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694024 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694189 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694356 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694495 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694632 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694812 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.694958 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695133 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695278 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695453 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695597 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695764 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.695906 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696078 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696229 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696428 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696575 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696714 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.696864 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697043 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697187 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697364 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697509 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697678 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697822 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.697997 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698148 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698371 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698524 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698662 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698798 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.698945 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699082 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699218 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699354 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699534 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699690 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699830 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.699967 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700144 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700341 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700509 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700657 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700796 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.700933 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701092 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701237 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701406 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701559 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701719 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.701870 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.702014 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.702160 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.702342 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.702498 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.702687 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.703340 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.703614 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.703940 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704028 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704257 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704379 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704598 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704698 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.704922 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705018 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705257 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705345 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705581 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705678 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.705908 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706002 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706240 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706339 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706556 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706652 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706872 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.706981 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707182 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707269 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707498 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707584 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707812 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.707905 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708129 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708215 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708467 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708567 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708791 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.708890 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709107 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709194 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709426 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709511 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709753 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.709840 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710079 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710164 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710399 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710484 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710719 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.710806 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711038 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711124 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711355 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711439 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711677 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711765 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.711997 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712083 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712320 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712418 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712647 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712734 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.712964 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713058 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713288 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713382 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713605 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713698 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.713923 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714009 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714238 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714332 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714553 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714638 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714869 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.714954 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715182 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715357 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715508 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715668 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715814 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.715965 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.716110 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.716395 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.716570 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.716717 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.716869 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717043 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717196 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717374 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717527 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717685 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717837 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.717981 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.718137 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.718432 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.718853 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719031 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719192 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719414 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719575 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719721 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.719865 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720042 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720213 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720398 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720558 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720710 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.720861 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721010 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721153 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721296 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721518 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721665 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721807 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.721950 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722094 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722255 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722400 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722543 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722686 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722829 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.722971 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723124 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723269 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723411 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723561 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723712 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.723856 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724011 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724167 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724336 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724487 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724631 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724809 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.724976 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725144 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725296 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725463 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725621 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725765 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.725917 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726089 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726251 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726416 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726568 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726724 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.726869 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.727011 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.727153 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.727425 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.727574 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728027 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728181 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728357 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728543 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728704 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.728918 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729079 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729225 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729370 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729512 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729654 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729803 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.729961 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730105 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730247 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730431 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730590 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730743 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.730888 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731045 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731193 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731336 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731487 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731644 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731797 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.731950 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732095 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732237 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732404 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732561 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732721 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.732866 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733016 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733160 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733310 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733454 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733606 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733751 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.733944 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.734183 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.734407 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.734700 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.734883 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735036 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735182 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735332 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735477 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735620 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735773 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.735917 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736068 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736213 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736400 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736562 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736719 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.736874 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737025 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737169 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737313 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737464 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737609 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737752 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.737894 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738036 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738178 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738329 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738482 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738626 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738781 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.738942 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739159 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739318 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739464 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739607 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739757 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.739902 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740045 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740204 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740373 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740534 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740698 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740843 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.740995 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741151 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741301 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741445 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741588 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741737 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.741894 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742047 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742192 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742334 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742483 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742641 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742801 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.742964 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743110 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743253 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743404 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743548 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743692 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743844 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.743990 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744133 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744284 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744485 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744642 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744794 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.744939 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745082 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745226 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745375 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745520 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745747 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.745894 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746037 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746181 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746323 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746475 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746639 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746784 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.746926 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747069 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747266 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747427 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747580 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747724 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.747867 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748010 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748153 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748328 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748490 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748645 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748789 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.748932 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.749075 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.749315 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750001 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750165 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750447 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750601 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750747 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.750902 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751055 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751207 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751364 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751540 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751700 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.751869 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752016 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752167 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752358 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752521 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752711 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.752861 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753038 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753186 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753329 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753484 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753637 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753782 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.753925 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754069 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754212 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754355 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754509 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754654 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754805 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.754949 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755093 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755253 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755406 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755552 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755696 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.755870 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756029 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756182 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756426 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756589 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756736 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.756881 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757032 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757185 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757339 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757483 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757627 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757771 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.757915 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758071 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758217 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758360 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758504 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758654 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758800 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.758953 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759098 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759258 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759499 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759658 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759804 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.759960 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760106 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760256 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760462 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760608 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760763 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.760910 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761054 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761205 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761360 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761504 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761656 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761808 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.761956 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762100 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762243 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762394 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762547 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762693 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.762863 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763023 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763168 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763321 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763496 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763649 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.763863 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764014 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764185 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764375 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764527 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764672 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.764836 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.765001 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.765223 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.765439 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.765636 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.765970 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766129 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766274 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766424 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766615 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766775 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.766927 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767072 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767216 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767359 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767538 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767708 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767854 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.767996 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768148 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768292 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768511 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768657 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768828 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.768977 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.769143 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.769304 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.769548 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.769710 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.769872 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770016 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770159 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770312 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770465 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770616 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770761 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.770903 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771047 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771200 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771346 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771489 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771767 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.771929 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772073 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772225 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772428 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772576 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772726 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.772869 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773021 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773165 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773308 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773451 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773630 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773781 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.773943 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774093 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774260 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774412 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774563 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774706 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.774857 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775008 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775182 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775341 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775487 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775628 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.775852 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776009 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776153 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776330 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776496 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776642 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776795 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.776940 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777084 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777265 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777418 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777571 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777717 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.777891 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778050 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778208 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778354 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778537 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778691 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.778871 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779030 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779174 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779318 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779472 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779634 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.779850 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.780008 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.780153 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.780341 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.780505 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.780650 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.781310 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.781458 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.781610 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.781932 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782128 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782286 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782455 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782606 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782799 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.782962 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783139 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783298 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783469 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783620 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783808 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.783968 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784114 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784256 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784464 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784610 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784754 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.784920 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785065 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785208 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785352 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785536 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785700 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785846 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.785991 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786140 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786285 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786462 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786622 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786774 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.786928 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787073 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787216 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787398 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787561 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787713 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.787858 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788001 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788144 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788394 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788528 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788662 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788753 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.788977 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789072 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789290 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789402 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789621 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789718 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.789938 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790023 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790268 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790358 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790592 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790690 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.790925 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791009 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791256 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791349 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791576 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791668 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791897 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.791987 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792214 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792325 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792554 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792640 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792868 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.792959 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793183 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793266 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793500 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793584 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793818 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.793902 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794145 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794228 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794464 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794550 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794789 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.794874 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795108 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795319 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795450 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795657 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795784 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.795982 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.796107 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.796320 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.796781 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797010 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797261 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797418 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797559 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797729 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.797872 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.798015 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.798164 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.798304 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.798628 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.798961 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.799297 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.799607 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.799697 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.800803 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801058 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801058 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801058 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801313 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801394 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801480 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801570 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801658 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.801919 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.802235 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.802562 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.802891 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.803213 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.808231 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.808352 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.808429 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.808513 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809172 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809274 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809345 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809423 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809490 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809563 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809653 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809734 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809819 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809899 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.809977 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810055 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810192 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810282 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810370 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810451 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810529 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810615 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810703 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810703 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810845 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.810923 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811008 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811008 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811168 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811247 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811325 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811402 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811487 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811487 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811487 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811704 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811782 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811866 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.811953 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812590 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812682 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812750 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812814 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812891 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.812956 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813042 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813122 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813207 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813287 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813364 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813450 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813530 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813608 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813608 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813608 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813817 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813903 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.813982 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814067 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814153 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814397 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814564 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814730 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.814922 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.815249 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.815334 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.815584 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.815670 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.815919 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816014 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816243 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816349 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816582 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816679 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.816937 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817050 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817238 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817376 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817556 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817653 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817877 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.817970 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818195 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818282 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818510 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818613 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818825 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.818985 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819145 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819363 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819452 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819547 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819769 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.819856 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820089 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820176 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820429 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820523 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820766 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.820852 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821080 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821191 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821396 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821484 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821709 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.821802 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822031 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822127 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822344 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822431 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822658 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822745 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.822971 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823072 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823283 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823371 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823601 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823688 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.823915 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824010 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824233 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824340 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824576 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824663 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824897 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.824997 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825210 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825327 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825525 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825612 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825838 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.825926 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826168 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826261 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826483 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826576 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826797 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.826892 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.827121 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.827243 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.827442 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.827539 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.828479 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.828809 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829063 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829151 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829414 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829530 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829772 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.829878 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830117 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830321 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830459 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830663 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830798 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.830990 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.831132 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.831476 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.831562 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.831800 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.831895 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832119 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832206 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832471 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832562 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832797 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.832908 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833117 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833205 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833434 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833519 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833755 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.833843 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834068 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834156 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834386 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834471 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834709 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.834796 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835024 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835255 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835343 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835615 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835705 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.835944 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836030 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836259 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836363 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836633 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836730 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.836958 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837043 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837272 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837358 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837594 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837680 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837911 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.837996 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838228 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838314 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838543 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838629 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838861 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.838946 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839173 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839271 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839487 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839597 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839810 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.839906 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840129 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840232 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840464 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840563 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840782 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.840892 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841097 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841196 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841434 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841520 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841751 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.841835 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842069 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842155 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842386 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842472 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842709 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.842818 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.843024 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.843154 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.843371 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.843529 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.843844 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844134 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844248 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844489 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844580 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844798 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.844884 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845120 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845223 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845444 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845529 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845763 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.845849 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846088 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846181 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846405 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846489 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846728 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.846812 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847047 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847132 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847368 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847452 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847691 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.847786 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848006 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848092 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848349 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848438 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848672 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.848756 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849001 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849088 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849323 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849407 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849646 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849741 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.849963 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850049 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850292 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850388 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850609 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850841 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.850936 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851184 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851268 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851514 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851598 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851866 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.851952 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.852185 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.852268 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.852542 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.852637 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853109 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853202 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853423 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853508 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853742 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.853825 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854063 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854168 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854382 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854490 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854715 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.854914 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855036 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855241 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855376 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855565 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855699 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.855887 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856022 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856210 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856363 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856558 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856688 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.856887 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857010 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857209 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857330 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857560 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857646 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.857890 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858019 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858214 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858347 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858542 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858673 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.858867 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.859514 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.859803 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860132 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860254 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860485 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860611 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860825 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.860951 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861145 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861270 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861470 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861596 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861791 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.861916 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862110 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862241 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862423 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862554 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862746 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.862875 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863081 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863213 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863423 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863570 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863747 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.863872 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864084 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864221 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864463 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864593 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864795 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.864914 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.865134 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.865245 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.865470 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.865592 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.865718 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 01:30:43.865859 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.866088 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.866405 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.866728 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.867087 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.867432 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.867762 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.868143 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.868462 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.868792 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.869115 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.869437 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.869758 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.870082 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.870411 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.870731 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.871059 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.871380 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.871712 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.872032 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.872384 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.872702 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.873030 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.873351 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.873676 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.874019 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.874341 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.875709 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.876041 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.876405 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.876732 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.877063 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.877400 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.877732 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.878056 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.878398 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.878720 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.879043 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.879364 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.879685 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.880009 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.880348 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.880675 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.881014 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.881331 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.881667 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.881998 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.882328 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.882658 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.882981 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884076 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884076 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884076 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884645 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884645 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.884952 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.885221 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.885560 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.885897 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.886233 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.886572 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.886930 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.887260 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.887616 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.887968 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:30:43.888202 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 01:30:43.898656 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_db.sqlalchemy.engines [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:43.924080 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_db.sqlalchemy.engines [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.143704 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.context [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),899e9673-49ec-499d-b8c9-5083af1a0741(cell1) {{(pid=78177) load_cells /opt/stack/nova/nova/context.py:464}} May 18 01:30:44.148000 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_concurrency.lockutils [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:30:44.149690 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_concurrency.lockutils [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:30:44.150499 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_concurrency.lockutils [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:30:44.152522 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_concurrency.lockutils [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:30:44.176260 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.context [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),899e9673-49ec-499d-b8c9-5083af1a0741(cell1) {{(pid=78178) load_cells /opt/stack/nova/nova/context.py:464}} May 18 01:30:44.177269 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_db.sqlalchemy.engines [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.179078 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_db.sqlalchemy.engines [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.180598 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:30:44.182275 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:30:44.183097 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:30:44.185117 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:30:44.213817 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG oslo_db.sqlalchemy.engines [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.216986 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_db.sqlalchemy.engines [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.217796 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_db.sqlalchemy.engines [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.249655 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_db.sqlalchemy.engines [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:30:44.641023 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: WARNING keystonemiddleware.auth_token [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:30:44.647699 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: WARNING keystonemiddleware.auth_token [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:30:44.651541 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: WARNING keystonemiddleware.auth_token [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:30:44.658179 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: WARNING keystonemiddleware.auth_token [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:30:44.864919 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: WARNING keystonemiddleware.auth_token [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:30:44.870136 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: WARNING keystonemiddleware.auth_token [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:30:44.871875 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: WARNING keystonemiddleware.auth_token [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:30:44.876020 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1aee349c0 pid: 78177 (default app) May 18 01:30:44.877705 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: WARNING keystonemiddleware.auth_token [None req-419f231e-b1bc-4aee-9249-5e09b1c58e75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:30:44.878179 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:30:44.879290 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001674 May 18 01:30:44.879706 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 789 bytes} [Tue May 18 01:30:44 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:30:44.882953 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1aee349c0 pid: 78178 (default app) May 18 01:32:04.670729 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:04.671664 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 18 01:32:04.672357 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:05.131433 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-158f2238-96d6-4398-9f43-d2dc73c7ff7b admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:05.272118 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-158f2238-96d6-4398-9f43-d2dc73c7ff7b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.592271 May 18 01:32:05.273406 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Tue May 18 01:32:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:32:07.409295 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:07.411973 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3887cd9a-869f-4b49-bc34-3d584889891a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002970 May 18 01:32:07.413361 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:07 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:07.474044 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-cd626c2b-a302-4c83-9644-722ff7cded20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:07.492743 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:32:07.492743 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: warnings.warn(msg) May 18 01:32:07.518242 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-cd626c2b-a302-4c83-9644-722ff7cded20 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.098207 May 18 01:32:07.520402 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:07.751418 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-c854b80b-2280-411e-8af4-10c58300580f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:07.753931 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:32:07.753931 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: warnings.warn(msg) May 18 01:32:07.918377 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-c854b80b-2280-411e-8af4-10c58300580f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.391586 May 18 01:32:07.950550 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Tue May 18 01:32:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:32:10.071465 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-cd626c2b-a302-4c83-9644-722ff7cded20 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:10.072513 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-cd626c2b-a302-4c83-9644-722ff7cded20 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 18 01:32:10.072922 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:10.193790 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-fb2d6120-5bae-4834-92ea-1621432b32ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:10.216325 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:32:10.216325 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: warnings.warn(msg) May 18 01:32:10.245093 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-fb2d6120-5bae-4834-92ea-1621432b32ae admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166034 May 18 01:32:10.246030 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:32:10.258933 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7969f50d-9c7a-45ba-8456-f28ca2ef9f0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:10.260520 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:32:10.260520 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: warnings.warn(msg) May 18 01:32:10.297127 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7969f50d-9c7a-45ba-8456-f28ca2ef9f0f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042799 May 18 01:32:10.297636 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Tue May 18 01:32:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:32:12.526423 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-fb2d6120-5bae-4834-92ea-1621432b32ae admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:12.528218 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-fb2d6120-5bae-4834-92ea-1621432b32ae admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002296 May 18 01:32:12.528964 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:32:12.585958 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-b9c80525-44e7-4d94-b2e3-8579fb546b2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 10, "id": "d2"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:12.611713 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-b9c80525-44e7-4d94-b2e3-8579fb546b2f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076883 May 18 01:32:12.612451 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:32:12.623989 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-4f54bcec-f8e0-49e8-8f52-6788a6d5214b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:12.659799 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-4f54bcec-f8e0-49e8-8f52-6788a6d5214b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039501 May 18 01:32:12.661121 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Tue May 18 01:32:12 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:32:14.841914 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-b9c80525-44e7-4d94-b2e3-8579fb546b2f admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:14.841914 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-b9c80525-44e7-4d94-b2e3-8579fb546b2f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 May 18 01:32:14.841914 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:14 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:14.943610 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3f0dc7b1-1a1c-404e-aad8-c871e58efc42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "ram": 2048, "id": "d3", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:14.980404 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3f0dc7b1-1a1c-404e-aad8-c871e58efc42 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132118 May 18 01:32:14.981051 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:14.994414 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-3e9f2440-fdeb-44d5-aa99-e10523b6ac72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:15.035837 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-3e9f2440-fdeb-44d5-aa99-e10523b6ac72 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045637 May 18 01:32:15.036557 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Tue May 18 01:32:14 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:32:17.188340 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3f0dc7b1-1a1c-404e-aad8-c871e58efc42 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:17.189367 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3f0dc7b1-1a1c-404e-aad8-c871e58efc42 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 18 01:32:17.190076 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:17.251479 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:17.278089 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081775 May 18 01:32:17.279193 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:17.292393 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-3afcf54f-980f-4fa1-8fa8-2ace9be7d684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:17.336762 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-3afcf54f-980f-4fa1-8fa8-2ace9be7d684 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048481 May 18 01:32:17.337701 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Tue May 18 01:32:17 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:32:19.666483 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:19.668130 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 May 18 01:32:19.668572 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:19.734341 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-2c0c662e-fabb-4c0c-ab9f-263a76e0480c admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:19.761316 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-2c0c662e-fabb-4c0c-ab9f-263a76e0480c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086537 May 18 01:32:19.762003 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Tue May 18 01:32:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:32:22.319669 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:22.320756 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-b14e2019-3785-4bb5-b2ee-7bd8790bbdec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 18 01:32:22.321176 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:22.385376 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-e0b7f9f7-1e6b-4b5b-8303-9d71b60c51fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 512, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:22.410192 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-e0b7f9f7-1e6b-4b5b-8303-9d71b60c51fe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081972 May 18 01:32:22.410736 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:22 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:22.424241 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-17ff71b6-e726-45d5-91e6-3937b4bdea1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:22.463515 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-17ff71b6-e726-45d5-91e6-3937b4bdea1e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042792 May 18 01:32:22.464045 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Tue May 18 01:32:22 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:32:25.239395 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-e0b7f9f7-1e6b-4b5b-8303-9d71b60c51fe admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:25.240956 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-e0b7f9f7-1e6b-4b5b-8303-9d71b60c51fe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002340 May 18 01:32:25.241603 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:25 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:25.305147 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-900d7027-7854-4152-9ff2-063394aea6f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "ram": 2048}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:25.335391 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-900d7027-7854-4152-9ff2-063394aea6f0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085100 May 18 01:32:25.336007 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:25.351455 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-cef3a303-e931-4bcf-8bc5-a5bdfbdf1391 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:25.403952 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-cef3a303-e931-4bcf-8bc5-a5bdfbdf1391 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058516 May 18 01:32:25.405077 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Tue May 18 01:32:25 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:32:27.586448 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-900d7027-7854-4152-9ff2-063394aea6f0 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:27.587488 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-900d7027-7854-4152-9ff2-063394aea6f0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 18 01:32:27.587878 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:27.645760 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-9a9ed1df-2b45-44f2-b95a-699ccc0a5820 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:27.670067 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-9a9ed1df-2b45-44f2-b95a-699ccc0a5820 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075796 May 18 01:32:27.670625 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:27 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:27.682333 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-36c7e87f-79a9-4d76-b265-aa96ab0447f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:27.717088 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-36c7e87f-79a9-4d76-b265-aa96ab0447f8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038164 May 18 01:32:27.717669 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Tue May 18 01:32:27 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:32:29.870575 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-9a9ed1df-2b45-44f2-b95a-699ccc0a5820 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:29.871596 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-9a9ed1df-2b45-44f2-b95a-699ccc0a5820 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 18 01:32:29.872011 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:29.936144 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-50c2f3d1-9e2c-4eac-9588-c55b84c95146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:29.966479 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-50c2f3d1-9e2c-4eac-9588-c55b84c95146 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088633 May 18 01:32:29.968075 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:32:29.980408 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-89d2ac85-9082-442e-9904-4248842af641 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:30.020808 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-89d2ac85-9082-442e-9904-4248842af641 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044336 May 18 01:32:30.021865 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Tue May 18 01:32:29 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:32:32.160932 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-50c2f3d1-9e2c-4eac-9588-c55b84c95146 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:32:32.162796 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-50c2f3d1-9e2c-4eac-9588-c55b84c95146 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 May 18 01:32:32.163402 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:32:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:32:32.226454 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:32.267756 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.098205 May 18 01:32:32.268804 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Tue May 18 01:32:32 2021] POST /compute/v2.1/flavors => generated 408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:32:32.280514 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-c1fe6535-cd1e-46fb-8c90-163f2727c8f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:32:32.334854 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-c1fe6535-cd1e-46fb-8c90-163f2727c8f9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058010 May 18 01:32:32.335454 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Tue May 18 01:32:32 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:33:10.126014 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:10.127027 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 May 18 01:33:10.127429 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Tue May 18 01:33:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:10.184521 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-6966fa01-74ab-4c5f-be35-ebac260d1647 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:10.207613 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-6966fa01-74ab-4c5f-be35-ebac260d1647 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074310 May 18 01:33:10.208138 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Tue May 18 01:33:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:11.589787 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:11.591081 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-8bc8eb96-51af-46be-8944-6c5ac4fcea50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 May 18 01:33:11.591482 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:11.798867 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-fb7cba16-4293-4a88-b8d9-c12c05c6ad5e admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:11.812572 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.wsgi [None req-fb7cba16-4293-4a88-b8d9-c12c05c6ad5e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 01:33:11.813328 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-fb7cba16-4293-4a88-b8d9-c12c05c6ad5e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:11.814123 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-fb7cba16-4293-4a88-b8d9-c12c05c6ad5e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.074474 May 18 01:33:11.814696 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1191 bytes} [Tue May 18 01:33:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 01:33:11.825375 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-d8f474a4-1f29-4da0-ab07-a63f05691411 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:11.846831 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-d8f474a4-1f29-4da0-ab07-a63f05691411 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025096 May 18 01:33:11.847385 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:11.857332 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-429264cd-f333-44fb-9b2d-24d51271b885 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:11.878311 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-429264cd-f333-44fb-9b2d-24d51271b885 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024452 May 18 01:33:11.878882 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:11.888683 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-404e78e0-adfd-452f-9035-96d2c55234bc admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:11.903989 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.wsgi [None req-404e78e0-adfd-452f-9035-96d2c55234bc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 01:33:11.905015 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-404e78e0-adfd-452f-9035-96d2c55234bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:11.907001 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-404e78e0-adfd-452f-9035-96d2c55234bc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.021090 May 18 01:33:11.907973 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1191 bytes} [Tue May 18 01:33:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 01:33:13.232615 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-429264cd-f333-44fb-9b2d-24d51271b885 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:13.233609 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-429264cd-f333-44fb-9b2d-24d51271b885 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 18 01:33:13.234004 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:13.415838 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-c7a75d83-1c66-4afa-b238-f1140fc24e92 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:13.427953 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.wsgi [None req-c7a75d83-1c66-4afa-b238-f1140fc24e92 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 01:33:13.428575 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-c7a75d83-1c66-4afa-b238-f1140fc24e92 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:13.429381 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-c7a75d83-1c66-4afa-b238-f1140fc24e92 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062877 May 18 01:33:13.429888 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1191 bytes} [Tue May 18 01:33:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 01:33:13.439541 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-6f0d4401-7cda-4671-94d0-2c4f82653c50 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:13.459751 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-6f0d4401-7cda-4671-94d0-2c4f82653c50 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024112 May 18 01:33:13.460318 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:13.470580 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-f18cfde8-1760-4544-bd5a-86ee776d1ffe admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:13.490329 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-f18cfde8-1760-4544-bd5a-86ee776d1ffe admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023933 May 18 01:33:13.490807 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:33:13.499836 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-15b8b4f4-9ba0-48ad-8762-5ae2a53f81b2 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:13.512442 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.wsgi [None req-15b8b4f4-9ba0-48ad-8762-5ae2a53f81b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 01:33:13.513016 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-15b8b4f4-9ba0-48ad-8762-5ae2a53f81b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:13.513793 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-15b8b4f4-9ba0-48ad-8762-5ae2a53f81b2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017493 May 18 01:33:13.514289 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1191 bytes} [Tue May 18 01:33:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 01:33:14.815752 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-f18cfde8-1760-4544-bd5a-86ee776d1ffe admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:14.816804 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-f18cfde8-1760-4544-bd5a-86ee776d1ffe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 18 01:33:14.817236 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:15.009399 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-521ebc79-5532-4e14-a361-eeac84265c74 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:15.021273 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.wsgi [None req-521ebc79-5532-4e14-a361-eeac84265c74 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 01:33:15.021787 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-521ebc79-5532-4e14-a361-eeac84265c74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:15.022569 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-521ebc79-5532-4e14-a361-eeac84265c74 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064549 May 18 01:33:15.023072 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1194 bytes} [Tue May 18 01:33:14 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 01:33:15.033272 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-19adf9a8-b23f-40f0-8908-0250adc90221 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:15.053704 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-19adf9a8-b23f-40f0-8908-0250adc90221 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024651 May 18 01:33:15.054260 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:15.064117 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:15.083905 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023559 May 18 01:33:15.084459 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1211 bytes} [Tue May 18 01:33:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:33:15.094252 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-9f8915cf-428d-43c7-b4d5-6acd4cbd9828 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:15.106297 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.wsgi [None req-9f8915cf-428d-43c7-b4d5-6acd4cbd9828 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 01:33:15.106864 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-9f8915cf-428d-43c7-b4d5-6acd4cbd9828 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:33:15.107639 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-9f8915cf-428d-43c7-b4d5-6acd4cbd9828 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017661 May 18 01:33:15.108132 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1194 bytes} [Tue May 18 01:33:15 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 01:33:16.420104 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:16.421173 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 18 01:33:16.421605 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:16.608472 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-23f1fe20-39be-473c-879f-7ec4e8f450a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:33:16.634223 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-23f1fe20-39be-473c-879f-7ec4e8f450a4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.076017 May 18 01:33:16.634678 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1236 bytes} [Tue May 18 01:33:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:33:17.923038 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:17.924088 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 May 18 01:33:17.924718 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:18.110922 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-843aed3f-ac3a-42f2-904b-fa0c46402778 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:33:18.134136 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-843aed3f-ac3a-42f2-904b-fa0c46402778 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.073241 May 18 01:33:18.134617 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1236 bytes} [Tue May 18 01:33:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:33:19.458332 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:19.459336 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 18 01:33:19.459734 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:19.650169 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-48874503-2534-43fa-89c2-7f62a402a0bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:33:19.674553 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-48874503-2534-43fa-89c2-7f62a402a0bb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.075109 May 18 01:33:19.675028 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1236 bytes} [Tue May 18 01:33:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:33:20.977497 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:20.978546 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 18 01:33:20.978944 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:21.167800 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-4eac352d-a738-4b63-a037-5d60e8415559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:33:21.191466 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-4eac352d-a738-4b63-a037-5d60e8415559 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.073619 May 18 01:33:21.191935 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1236 bytes} [Tue May 18 01:33:21 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:33:22.492612 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:22.493627 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 18 01:33:22.494062 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:33:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:33:22.678786 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-94cb9a00-4dce-441a-91b0-9d2f15f38450 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:33:22.705150 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-94cb9a00-4dce-441a-91b0-9d2f15f38450 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076023 May 18 01:33:22.705621 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1203 bytes} [Tue May 18 01:33:22 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:34:05.912850 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:34:05.913862 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7441fb18-051a-41e4-804b-c47cdffa90ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 18 01:34:05.914262 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 31/63] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:34:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:34:06.104150 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:34:06.130692 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076492 May 18 01:34:06.131229 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1203 bytes} [Tue May 18 01:34:06 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:35:21.276172 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-fdcdeed9-2890-4c3d-a28a-74d7c01ba558 tempest-verify_tempest_config-275352431 tempest-verify_tempest_config-275352431-project] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:35:21.278150 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-fdcdeed9-2890-4c3d-a28a-74d7c01ba558 tempest-verify_tempest_config-275352431 tempest-verify_tempest_config-275352431-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113562 May 18 01:35:21.278676 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1134 bytes} [Tue May 18 01:35:21 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:36:47.617965 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:36:47.618966 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 18 01:36:47.619356 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 34/66] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:36:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:36:47.873363 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:36:47.874527 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:36:47.874527 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: warnings.warn(msg) May 18 01:36:47.876664 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:36:47.877123 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:36:47.877923 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:36:47.878364 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:36:47.917352 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-d530ab97-2bde-4a2a-a226-c19c02ed9225 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.161206 May 18 01:36:47.917910 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1194 bytes} [Tue May 18 01:36:47 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:36:49.220434 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: DEBUG nova.api.openstack.wsgi [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] Calling method '>' {{(pid=78177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:36:49.221379 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: INFO nova.api.openstack.requestlog [None req-10d16b6c-0fd3-43be-bbe2-c4eea340b762 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 May 18 01:36:49.221770 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: [pid: 78177|app: 0|req: 35/68] 10.222.0.16 () {56 vars in 1075 bytes} [Tue May 18 01:36:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:36:49.428604 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG nova.api.openstack.wsgi [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] Calling method '>' {{(pid=78178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:36:49.429759 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:36:49.429759 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: warnings.warn(msg) May 18 01:36:49.431282 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:36:49.431736 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:36:49.432559 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:36:49.432994 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: DEBUG oslo_concurrency.lockutils [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:36:49.458064 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: INFO nova.api.openstack.requestlog [None req-7c706381-55bc-4a54-82d9-e84f1497ba46 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.083488 May 18 01:36:49.458617 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: [pid: 78178|app: 0|req: 34/69] 10.222.0.16 () {60 vars in 1194 bytes} [Tue May 18 01:36:49 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:37:42.308581 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: Tue May 18 01:37:42 2021 - graceful shutdown triggered... May 18 01:37:42.309082 dv-cinder-784623-9-iscsi devstack@n-api.service[78177]: Gracefully killing worker 1 (pid: 78177)... May 18 01:37:42.308845 dv-cinder-784623-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 18 01:37:42.309857 dv-cinder-784623-9-iscsi devstack@n-api.service[78178]: Gracefully killing worker 2 (pid: 78178)... May 18 01:37:43.310243 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: worker 1 buried after 1 seconds May 18 01:37:43.310243 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: worker 2 buried after 1 seconds May 18 01:37:43.310243 dv-cinder-784623-9-iscsi devstack@n-api.service[78176]: goodbye to uWSGI. May 18 01:37:43.311243 dv-cinder-784623-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 18 01:37:43.311789 dv-cinder-784623-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 18 01:37:43.314608 dv-cinder-784623-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 01:37:43.325083 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 18 01:37:43 2021] *** May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: nodename: dv-cinder-784623-9-iscsi May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: machine: x86_64 May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: clock source: unix May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: pcre jit disabled May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: detected number of CPU cores: 4 May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: current working directory: / May 18 01:37:43.327081 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: detected binary path: /usr/bin/uwsgi-core May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: your processes number limit is 47680 May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: your memory page size is 4096 bytes May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: detected max file descriptor number: 2048 May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: lock engine: pthread robust mutexes May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: thunder lock: enabled May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 01:37:43.327731 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 18 01:37:43.371709 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: Python main interpreter initialized at 0x5633554d59c0 May 18 01:37:43.371709 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: python threads support enabled May 18 01:37:43.371709 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: your server socket listen backlog is limited to 100 connections May 18 01:37:43.371709 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: your mercy for graceful operations on workers is 90 seconds May 18 01:37:43.372110 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: mapped 403077 bytes (393 KB) for 2 cores May 18 01:37:43.372222 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: *** Operational MODE: preforking *** May 18 01:37:43.372528 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: *** uWSGI is running in multiple interpreter mode *** May 18 01:37:43.372528 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: spawned uWSGI master process (pid: 92930) May 18 01:37:43.372730 dv-cinder-784623-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 01:37:43.373328 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: spawned uWSGI worker 1 (pid: 92948, cores: 1) May 18 01:37:43.373686 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: spawned uWSGI worker 2 (pid: 92949, cores: 1) May 18 01:37:43.373840 dv-cinder-784623-9-iscsi devstack@n-api.service[92930]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 01:37:45.147061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:37:45.147061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: from cryptography.utils import int_from_bytes May 18 01:37:45.147733 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:37:45.147733 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: from cryptography.utils import int_from_bytes May 18 01:37:45.174770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:37:45.174770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: from cryptography.utils import int_from_bytes May 18 01:37:45.175397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 01:37:45.175397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: from cryptography.utils import int_from_bytes May 18 01:37:47.583101 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 01:37:47.583641 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 01:37:47.583759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 01:37:47.584095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 01:37:47.584367 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 01:37:47.584763 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.585094 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.585424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.585752 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.586092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.586411 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.586798 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.587183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.587567 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.587839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.588167 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.588571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-9-iscsi {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.588903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.589218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.589537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.589863 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.590176 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.590506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.590818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.591323 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.592038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.594451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.595085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.595600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.595781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.596445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.596797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.597139 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.597484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.598337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.598682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-9-iscsi {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.599009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.599617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.599954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.600495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.600913 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.601253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.601588 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.601925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.602246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.602589 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.602919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.603248 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.603581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.603892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.604207 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.604556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.604885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.605200 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.605510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.605772 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.606086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.606415 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.606746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.607096 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.607340 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.607594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.607920 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.608249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.608590 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.608908 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.609226 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.609537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.609851 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.610166 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.610477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.610787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.611113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.611436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.611765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.612080 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.612435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.612840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.613096 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.613484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.613947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.614279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.614598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.614926 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.615258 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.615615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.615986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.616364 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.616700 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.617035 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.617356 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.617654 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.617968 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.618283 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.618610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.618982 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.619237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.619549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.619855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.620166 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.620506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.620821 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.621134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.621596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.622070 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.622546 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.623103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.623578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.624069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.624571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.625051 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.625514 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.625996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.626470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.626949 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.627429 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.627900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.628409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.628874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.629924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.630412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.630896 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.631370 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.631847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.632321 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.632785 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.633282 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.633761 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.634225 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.634687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.635151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.635624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.636104 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.636599 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.637073 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.637543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.638030 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.638509 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.638990 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.639454 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.639931 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.640439 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.640954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.641451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.641966 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.642441 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.642942 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.643063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 01:37:47.643479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 01:37:47.643779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 01:37:47.643986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.644164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 01:37:47.644412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.644514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 01:37:47.644750 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.644943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.645107 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.645430 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.645556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.645882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.645985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.646220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.646344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.646553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.646663 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.646890 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.646999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.647225 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.647323 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.647559 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.647662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.647894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.648003 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.648156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.648254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.648514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.648616 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.648854 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-9-iscsi {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.648980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.649196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.649300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.649518 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.649621 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.649845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.650011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.650162 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.650304 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.650480 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.650643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.650820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.650981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.651135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.651305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.651486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.651652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.651822 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.651997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.652140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.652322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.652483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.652639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.652782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.652938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.653082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.653232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.653388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.654065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.654243 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.654401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.654617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.654774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.654938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.655084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.655226 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.655393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.655551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.655702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-9-iscsi {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.655890 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.656046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.656199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.656391 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.656548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.656704 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.656846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.656999 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.657150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.657299 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.657450 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.657605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.657757 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.657900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.658048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.658192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.658967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.659131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.659286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.659450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.659600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.659752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.659969 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.660131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.660817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.661041 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.661201 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.661355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.661508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.661657 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.661800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.661941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.662093 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.662093 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.662386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.662530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.662671 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.662812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.662962 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.663112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.663263 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.663407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.663557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.663786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.663943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.664180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.664350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.664499 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.664655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.664803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.664952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.665109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.665260 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.665404 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.665548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.665690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.665851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.666003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.666145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.666287 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.666428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.666571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.666726 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.666880 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.667033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.667183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.667340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.667490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.667643 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.667795 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.667936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.668084 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.668226 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.668401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.668988 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.669228 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.669384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.669665 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.669826 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.669980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.670123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.670272 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.670430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.670580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.670726 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.670876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.671052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.671298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.671455 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.671598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.671740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.672065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.672224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.672390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.672577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.672747 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.672893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.673048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.673206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.673360 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.673503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.673652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.673820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.674044 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.674205 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.674348 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.674498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.674648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.674801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.674952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.675108 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.675251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.675393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.675541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.675684 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.675845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.676076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.676222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.676429 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.676590 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.676752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.676909 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.677060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.677203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.677352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.677495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.677645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.677797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.677939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.678090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.678233 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.678388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.678388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.679108 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.679366 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.679525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.679676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.679819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.679961 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.680114 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.680265 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.680569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.680728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.680880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.681046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.681196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.681408 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.681557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.681557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.681826 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.681981 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.682131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.682275 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.682424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.682567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.682708 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.682870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.682870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.683140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.683303 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.683454 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.683597 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.683738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.684046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.685351 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.686160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.686326 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.686474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.686623 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.686766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.686917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.687073 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.687222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.687373 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.687527 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.687746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.687901 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.688044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.688185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.688349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.688497 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.688650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.689150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.689400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.689574 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.689720 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.689870 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.690028 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.690172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.690342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.690585 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.690801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.690948 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.691113 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.691267 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.691411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.692131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.692460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.692629 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.692795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.692940 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.693091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.693241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.693384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.693532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.693688 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.693832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.693974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.694123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.694297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.694516 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.694742 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 01:37:47.694889 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695039 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695190 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695333 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695769 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.695912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696277 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.696770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697495 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697646 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.697953 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698252 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.698703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.699347 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.699595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.699746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.699896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.700040 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.700191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.700405 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.700582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.700846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701216 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701668 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701810 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.701959 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702110 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702414 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.702858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703002 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.703883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.704909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705347 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705636 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.705930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706072 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706214 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706497 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706808 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.706951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707100 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707621 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.707928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708566 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.708893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.709433 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.709746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.709916 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.710069 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.710219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.710370 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.710528 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.710723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711721 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.711910 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712241 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712441 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712753 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.712958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713405 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713718 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.713877 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714028 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714177 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.714326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.715318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716191 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716527 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716833 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.716992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.717556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.717722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.717872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.718031 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.718443 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.718593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.718748 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.718896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.719046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.719640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.719822 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.720084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.720250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.720436 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.720690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.720854 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.721031 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.721375 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.721540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.721698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.721865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.722016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.722167 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.722317 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.722474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.722623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.723368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.723596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.723747 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.723890 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724039 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724762 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.724912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725313 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725627 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.725929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726534 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.726975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727274 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.727855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.731054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.731222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.731564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.731736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.731892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732631 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.732951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733110 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733418 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.733877 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734176 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734324 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.734960 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.735135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.735410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.735568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.735718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.735883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736182 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736361 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736517 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.736996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737445 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.737908 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738206 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738456 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738653 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.738965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739290 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.739915 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.740065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.740224 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.740454 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.741108 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.741269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.741428 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.741764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.741932 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742248 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742441 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.742910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743235 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.743857 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744025 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.744980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.745131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.745288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.745543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.745701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.745850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746182 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746332 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.746936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.747880 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.748040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.748198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.748387 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.748700 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.748873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749340 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749657 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.749972 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.750121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.750121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.750424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.751233 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.751409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.751409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.751802 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752042 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752672 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752820 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.752969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.753270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.753270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.753554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.753704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.753852 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.754532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.754701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.754852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755549 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.755967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.756269 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.756445 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.756595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.756831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.756984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757280 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757588 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757747 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.757907 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758361 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.758974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759427 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759735 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.759903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.760061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.760217 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.760423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.760586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.760755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.761342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.761514 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.761673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.761925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762826 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.762991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763441 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763441 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763723 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.763881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764511 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.764850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765160 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765308 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.765803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766197 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766671 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766823 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.766980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767672 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.767929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768202 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768399 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768668 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.768944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769073 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.769858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770437 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.770991 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.771544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.771680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.771823 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772574 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772704 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.772978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773242 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773378 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773660 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.773917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774580 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774723 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774852 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.774980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.775885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.776527 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.776665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.776665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.776918 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777296 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777576 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.777965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778093 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778221 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.778882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779555 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.779954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780376 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780376 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780628 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.780758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.781010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.781146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.781146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.781812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.781947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782291 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782291 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782640 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782782 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.782782 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783035 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783404 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783791 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783919 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.783919 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784671 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784671 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.784911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.785049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.785049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786012 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786842 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.786973 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787626 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.787769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.788935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789072 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789203 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789472 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.789986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.790872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.791007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.791143 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.791279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.791279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.791838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792835 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.792977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793310 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.793973 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.794898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795811 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.795948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.796082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.796220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.796542 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.796708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.796908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797427 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797802 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.797939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.798132 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.798442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.798588 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.798778 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.798992 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.799132 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.799425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.799559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.799759 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.799951 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.800193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.800477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.800611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.800953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.801095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.801440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.801859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802001 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802444 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802585 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.802980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.803289 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.803442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.803609 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.803790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.803933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.804246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.804417 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.804620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.804774 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.804948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.805260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.805401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.805578 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.805796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.805928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.806218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.806348 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.806540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.806762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.806909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.807182 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.807318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.807516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.807702 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.807912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.808157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.808455 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.808605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.808832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.808970 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.809151 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.809435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.809575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.809772 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.809957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.810130 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.810442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.810574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.810774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.810958 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.811120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.811424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.811557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.811949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812094 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812823 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.812950 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.813125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.813923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814453 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814866 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.814996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.815219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.815359 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.815586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.815899 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.816046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.816265 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.817439 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.817668 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.817815 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.817954 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.818167 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.818345 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.818637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.818937 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.819111 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.819253 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.819646 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.819789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.820089 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.820270 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.820984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821653 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.821791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.822415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.822677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.822891 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823371 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.823924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824192 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.824962 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825264 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825587 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.825953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.826231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.826362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.826559 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.826859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.827140 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.827281 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.827585 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.827719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.827859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.828090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.828232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.828462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.828593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.828800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829440 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.829980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.830120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.830400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.830538 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.830744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.830908 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.831086 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.831350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.831497 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.831772 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.831903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.833981 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.834113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.834249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.834566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.834708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.834949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835460 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.835987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.836272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.836598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.836693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.836933 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837025 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837270 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837783 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.837935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838078 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838250 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838581 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838732 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.838908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839251 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839607 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.839942 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.840269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.840390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.840623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.840732 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.840956 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.841048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.841346 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.841506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.841709 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.841842 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.842875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.843038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.843473 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.843654 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.843818 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844150 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.844917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.845901 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846777 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.846878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.847110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.847203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.847435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.847525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.847812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.848121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.848235 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.848503 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.848712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.848838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849390 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.849820 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850380 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.850812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851499 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.851831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852418 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852661 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.852976 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.853246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.853349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.853566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.853670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.853915 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854030 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854221 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854557 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.854977 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855504 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.855930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856812 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.856930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.857125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.857262 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.857447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.857532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861374 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861672 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861757 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861852 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.861936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862018 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862099 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862262 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862856 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.862947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.863030 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.863110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.863209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.864855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.865166 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.865255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.865575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.865689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866039 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866467 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.866834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867392 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.867832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868055 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868508 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.868853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869503 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869734 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.869836 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870168 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.870824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871376 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871496 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.871795 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.872832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873059 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873149 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873527 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.873810 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874139 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874360 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874466 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874686 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.874777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875021 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875366 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875468 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.875786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.876014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.876113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.876402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.876497 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.876643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 01:37:47.876798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.877136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.877473 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.877800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.878161 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.878516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.878859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.879939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.880479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.880811 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.881137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.881471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.881835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.882194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.882530 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.882870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.883219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.883551 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.883877 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.884205 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.884656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.884985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.885320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.885646 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.885996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.886301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.886640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.886966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.887298 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.887616 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.887944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.888269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.888624 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.888975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.889307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.889645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.889973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.890310 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.890633 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.890970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.891306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.891638 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.891970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.892335 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.892665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.892992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.893319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.893645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.893970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.894296 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.894751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.895497 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.895806 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.896154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.896518 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.896861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.897195 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.897524 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.897871 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.898202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.898536 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.898866 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.899191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.899522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.899853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.900192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.900558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.900898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.901239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.901679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.901933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.902292 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.902630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 01:37:47.902881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 01:37:47.911302 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_db.sqlalchemy.engines [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:47.936698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.253183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.context [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),899e9673-49ec-499d-b8c9-5083af1a0741(cell1) {{(pid=92948) load_cells /opt/stack/nova/nova/context.py:464}} May 18 01:37:48.258221 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:37:48.260341 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:37:48.260767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:37:48.262789 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:37:48.284172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.context [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),899e9673-49ec-499d-b8c9-5083af1a0741(cell1) {{(pid=92949) load_cells /opt/stack/nova/nova/context.py:464}} May 18 01:37:48.288531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_db.sqlalchemy.engines [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.289096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:37:48.289350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_db.sqlalchemy.engines [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.290826 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:37:48.291807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:37:48.293862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:37:48.318143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.321666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_db.sqlalchemy.engines [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.325717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.356624 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 01:37:48.637094 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: WARNING keystonemiddleware.auth_token [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:37:48.643881 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: WARNING keystonemiddleware.auth_token [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:37:48.665026 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: WARNING keystonemiddleware.auth_token [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:37:48.672207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: WARNING keystonemiddleware.auth_token [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:37:48.862978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: WARNING keystonemiddleware.auth_token [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:37:48.868967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: WARNING keystonemiddleware.auth_token [None req-6a9b1880-21da-45a7-8468-617a53c6bd17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:37:48.874351 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633554d59c0 pid: 92948 (default app) May 18 01:37:48.887997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: WARNING keystonemiddleware.auth_token [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 01:37:48.893372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: WARNING keystonemiddleware.auth_token [None req-ad0a6c5d-823f-4f2d-8b92-df7629166868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 01:37:48.899067 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633554d59c0 pid: 92949 (default app) May 18 01:38:22.883804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ffd855fb-d90a-41f7-8017-72812b07b8c6 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Action: 'create', calling method: .version_select at 0x7efcdad0faf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1762491975"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:23.929276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2008404176", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "34ad0de6-e603-440b-8c73-37173bf6aad9"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:24.467681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] validate_networks() for [('34ad0de6-e603-440b-8c73-37173bf6aad9', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:38:24.559556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ffd855fb-d90a-41f7-8017-72812b07b8c6 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.749565 May 18 01:38:24.560442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Tue May 18 01:38:20 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3752 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 01:38:24.586451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-95682642-6fa5-4614-94d8-0d185c18c426 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcdab14280>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:24.737638 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-95682642-6fa5-4614-94d8-0d185c18c426 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 200 len: 345 microversion: 2.1 time: 0.155901 May 18 01:38:24.738205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:38:24 2021] GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:25.243410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1772543092", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "07f63989-c172-4c4a-baec-eebb444ddbc3"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:25.373112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] validate_networks() for [('07f63989-c172-4c4a-baec-eebb444ddbc3', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:38:25.969198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:38:25.978357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:38:25.980283 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:38:25.980761 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:38:25.981206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:38:26.066523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:26.068471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:26.078290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:26.078751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:26.123410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:26.130154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for user 51d547b6ec5747ac8cf1a52579144454 and project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:26.144599 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:38:26.147967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:38:26.323417 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-36c07f2b-4581-486b-9f49-0a43779ba402 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.637475 May 18 01:38:26.331350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:38:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 3647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:38:26.339718 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e4f359a4-56f3-43db-8ffd-ad39ab6770b9 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcdaaa0430>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:26.505498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e4f359a4-56f3-43db-8ffd-ad39ab6770b9 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 200 len: 346 microversion: 2.1 time: 0.170873 May 18 01:38:26.507775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:38:26 2021] GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:26.513860 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4041ae76-ac50-4f48-a9b7-a36674970548 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:26.514801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4041ae76-ac50-4f48-a9b7-a36674970548 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:26.799710 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:38:26.800865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:38:26.801800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:38:26.802446 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:38:26.803164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:38:26.812923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4041ae76-ac50-4f48-a9b7-a36674970548 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:26.817885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:26.818755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:26.820127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:26.820800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:26.835585 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4041ae76-ac50-4f48-a9b7-a36674970548 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1218 microversion: 2.1 time: 0.326267 May 18 01:38:26.848630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:26 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1218 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:26.854391 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5c7b00ef-4cf0-4540-ada8-966a404c1351 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Action: 'create', calling method: .version_select at 0x7efcda221700>, body: {"snapshot": {"volume_id": "3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1495702052"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:26.860762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Getting quotas for project 6822df35a65f454ba97b1301b17f8b18. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:26.877807 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Getting quotas for user 5039f9f63f584c319b63362df5284995 and project 6822df35a65f454ba97b1301b17f8b18. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:26.895887 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:38:26.899685 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:38:27.091785 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3f0c7ffe-6a46-4ad3-a40f-8caed9df352a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911596 May 18 01:38:27.096769 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 3/6] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:38:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 01:38:27.113909 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ef2c0470-1133-4b70-8499-c6663d602a39 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:27.118778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ef2c0470-1133-4b70-8499-c6663d602a39 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:27.500512 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ef2c0470-1133-4b70-8499-c6663d602a39 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:27.514232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5c7b00ef-4cf0-4540-ada8-966a404c1351 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.664260 May 18 01:38:27.516666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1162 bytes} [Tue May 18 01:38:26 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:27.525334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ef2c0470-1133-4b70-8499-c6663d602a39 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1215 microversion: 2.1 time: 0.421998 May 18 01:38:27.526557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-162ea3a6-95fe-4031-ac11-2b6c46d2d616 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda1f3430>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:27.527334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:27 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1215 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:27.658794 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-162ea3a6-95fe-4031-ac11-2b6c46d2d616 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 287 microversion: 2.1 time: 0.136172 May 18 01:38:27.659843 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:27 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:27.669634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-635700f2-827c-4899-8acb-265e39b539d5 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcdaa08790>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:27.763340 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-635700f2-827c-4899-8acb-265e39b539d5 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097003 May 18 01:38:27.764260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1140 bytes} [Tue May 18 01:38:27 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:27.776080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cb85679a-ecbb-45c8-aef7-958a79e338e2 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda207e50>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:27.854931 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-be23e7e8-035e-45ce-b193-e9d2592a3cf0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:27.856144 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-be23e7e8-035e-45ce-b193-e9d2592a3cf0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:27.881878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cb85679a-ecbb-45c8-aef7-958a79e338e2 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 287 microversion: 2.1 time: 0.110650 May 18 01:38:27.883526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:27 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:28.338559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-be23e7e8-035e-45ce-b193-e9d2592a3cf0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:28.348685 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-be23e7e8-035e-45ce-b193-e9d2592a3cf0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1218 microversion: 2.1 time: 0.497234 May 18 01:38:28.349479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:27 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1218 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:28.553823 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:28.559586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:28.572662 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:28.573218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:28.574092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:28.574713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:28.895412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c447d088-8f28-40a9-a55e-352836e4dbea tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcdaba0ca0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:28.929583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:28.943727 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7489937f-0f76-4e8b-8684-2e98d7a9ec35 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1219 microversion: 2.1 time: 0.401628 May 18 01:38:28.951375 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:28 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1219 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:29.001729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c447d088-8f28-40a9-a55e-352836e4dbea tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 287 microversion: 2.1 time: 0.109939 May 18 01:38:29.006521 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:28 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:29.367977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:29.369281 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:29.403693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:29.404068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:29.404935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:29.405381 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:29.624682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:29.635254 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-62460769-62ea-466b-950f-0eaa350e3f1b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1222 microversion: 2.1 time: 0.272123 May 18 01:38:29.644960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:29 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:29.961803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:29.962493 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:29.976542 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:29.979413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:29.982794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:29.986948 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:30.013600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cc7a1233-76b9-4dbd-ad62-e3e356a346aa tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda124040>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:30.122723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cc7a1233-76b9-4dbd-ad62-e3e356a346aa tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 287 microversion: 2.1 time: 0.113114 May 18 01:38:30.123295 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:30 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:30.271685 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:30.304767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-77962237-1081-4c36-a10f-00f87e5c904b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1219 microversion: 2.1 time: 0.347192 May 18 01:38:30.310678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:29 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1219 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:30.653032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:30.653658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:30.668190 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:30.668962 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:30.669923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:30.676515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:31.134607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d2ebf47b-fc4d-457f-817a-ca12b8a06a6a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda122e50>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:31.182896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:31.192641 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4774b696-ebe0-4339-9a31-139f6797ad30 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1222 microversion: 2.1 time: 0.543429 May 18 01:38:31.197021 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:30 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1222 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:31.291936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d2ebf47b-fc4d-457f-817a-ca12b8a06a6a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 288 microversion: 2.1 time: 0.161374 May 18 01:38:31.292562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:31 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:38:31.327414 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:31.328377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:31.346226 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:31.346980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:31.347948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:31.348568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:31.362807 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5d7f4320-c56e-4a4c-9451-0135fa8938e4 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda122310>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:31.670275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5d7f4320-c56e-4a4c-9451-0135fa8938e4 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 202 len: 0 microversion: 2.1 time: 0.312090 May 18 01:38:31.671033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 10/20] 10.222.0.16 () {58 vars in 1254 bytes} [Tue May 18 01:38:31 2021] DELETE /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:38:31.680193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dbaafd21-cc56-437c-9553-f1d4bb60c92b tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda1300d0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:31.779987 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dbaafd21-cc56-437c-9553-f1d4bb60c92b tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 200 len: 287 microversion: 2.1 time: 0.103407 May 18 01:38:31.785189 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:31 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:31.975380 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:31.985189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e6f5b376-226f-4db8-8efd-186fcb070f5c tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1211 microversion: 2.1 time: 0.661444 May 18 01:38:31.985970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:31 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1211 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:32.213068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:32.214289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:32.235623 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:32.239220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:32.240286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:32.240979 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:32.633815 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:32.646222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9d5d22b2-68df-417d-82b3-957a9165c7dc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1278 microversion: 2.1 time: 0.436653 May 18 01:38:32.646813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:32 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1278 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:32.792933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-61ff77a1-5f77-4558-89cb-48c200425709 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda12d790>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:32.871143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-61ff77a1-5f77-4558-89cb-48c200425709 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] HTTP exception thrown: Snapshot 401e335a-0d18-4a9a-8402-c918fc616326 could not be found. May 18 01:38:32.872050 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-61ff77a1-5f77-4558-89cb-48c200425709 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Returning 404 to user: Snapshot 401e335a-0d18-4a9a-8402-c918fc616326 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:38:32.874922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-61ff77a1-5f77-4558-89cb-48c200425709 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326" status: 404 len: 111 microversion: 2.1 time: 0.086119 May 18 01:38:32.876237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:38:32 2021] GET /compute/v2.1/os-snapshots/401e335a-0d18-4a9a-8402-c918fc616326 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:38:32.884079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a9fb40ce-3f6a-4d9f-8515-3226b710582b tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda130430>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:33.005508 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:33.006468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:33.059058 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a9fb40ce-3f6a-4d9f-8515-3226b710582b tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 202 len: 0 microversion: 2.1 time: 0.178164 May 18 01:38:33.060099 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:38:32 2021] DELETE /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:38:33.063943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:33.068412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-382d011d-cd92-492c-a85b-7f35eb857137 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda130f70>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:33.076990 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:33.077950 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:33.081627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:33.278720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-382d011d-cd92-492c-a85b-7f35eb857137 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 200 len: 345 microversion: 2.1 time: 0.214258 May 18 01:38:33.279615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:38:33 2021] GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:33.569089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:33.597586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-36b524ba-3896-4928-8446-ed2871d0b483 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1275 microversion: 2.1 time: 0.578617 May 18 01:38:33.598683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:32 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1275 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:33.664334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:33.665267 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:33.676749 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:33.680915 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:33.684619 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:33.685291 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:33.903045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:33.915817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e8200436-3709-4f22-9087-f5d779fc8a28 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1276 microversion: 2.1 time: 0.255848 May 18 01:38:33.918964 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:33 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:34.293856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-107f80dd-b222-4851-876f-0a2f653f561a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda11baf0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:34.443946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-107f80dd-b222-4851-876f-0a2f653f561a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] HTTP exception thrown: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. May 18 01:38:34.444778 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-107f80dd-b222-4851-876f-0a2f653f561a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Returning 404 to user: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:38:34.445764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-107f80dd-b222-4851-876f-0a2f653f561a tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 404 len: 109 microversion: 2.1 time: 0.157252 May 18 01:38:34.446729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:38:34 2021] GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:38:34.491080 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1bb6b2aa-d58c-479b-a230-604c5ac98387 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcda0df310>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:34.616425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:34.617152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:34.660388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:34.662160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:34.663023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:34.663469 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:34.674062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-1bb6b2aa-d58c-479b-a230-604c5ac98387 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] HTTP exception thrown: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. May 18 01:38:34.674672 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1bb6b2aa-d58c-479b-a230-604c5ac98387 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Returning 404 to user: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:38:34.675509 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1bb6b2aa-d58c-479b-a230-604c5ac98387 tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 404 len: 109 microversion: 2.1 time: 0.200027 May 18 01:38:34.676413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:38:34 2021] DELETE /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:38:34.686984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6e06ba06-89ad-4298-8261-a065fded0f5e tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Calling method '.version_select at 0x7efcdad0fb80>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:34.867073 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-6e06ba06-89ad-4298-8261-a065fded0f5e tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] HTTP exception thrown: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. May 18 01:38:34.868183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6e06ba06-89ad-4298-8261-a065fded0f5e tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] Returning 404 to user: Volume 3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:38:34.869055 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6e06ba06-89ad-4298-8261-a065fded0f5e tempest-VolumesSnapshotsTestJSON-377486795 tempest-VolumesSnapshotsTestJSON-377486795-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf" status: 404 len: 109 microversion: 2.1 time: 0.188888 May 18 01:38:34.869648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:38:34 2021] GET /compute/v2.1/os-volumes/3ed326be-f2b2-4c7c-8f91-53c57d6a1dbf => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:38:34.935212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:34.935843 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:34.958181 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:34.958718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:34.961852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:34.962334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:35.533383 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:35.545406 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:35.549139 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-52ff951a-8eb1-4e81-9b5d-41da15f5ff21 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1273 microversion: 2.1 time: 0.935902 May 18 01:38:35.553514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 15/32] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:34 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1273 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:35.577532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-89045c6c-9ac8-4d15-9571-29e293be67b1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1276 microversion: 2.1 time: 0.637550 May 18 01:38:35.583872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 18/33] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:34 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1276 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:36.569092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:36.571057 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:36.587066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:36.587525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:36.588434 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:36.601121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:36.602395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:36.604830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:36.632712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:36.634033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:36.635322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:36.636193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:36.940108 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:36.950185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c347e93a-154b-4c38-9360-c23efbfd3544 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1276 microversion: 2.1 time: 0.354883 May 18 01:38:36.962025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 19/34] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:36 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1276 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:37.086320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:37.102243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-22bfb9ec-e5ad-4d53-bf16-914396ee41d2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1273 microversion: 2.1 time: 0.536995 May 18 01:38:37.103119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:36 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1273 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:37.978991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:37.980491 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:37.999251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:38.000736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:38.001738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:38.002369 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:38.119214 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:38.120959 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:38.135847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:38.141234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:38.145803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:38.146562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:38.538062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:38.561338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-64d5723e-6546-4398-94c8-ee700bd16749 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1276 microversion: 2.1 time: 0.584635 May 18 01:38:38.562276 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 20/36] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:37 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1276 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:38.614900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:38.625875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0f27327b-61c4-40e4-a1ca-634e14870ebb tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1273 microversion: 2.1 time: 0.509908 May 18 01:38:38.631751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:38 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1273 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:39.579184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:39.580503 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:39.604932 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:39.607482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:39.608930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:39.612133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:39.648918 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:39.649830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:39.670026 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:39.671474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:39.673415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:39.677452 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:43.815579 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:43.840925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d3fc7e95-801d-4b07-a0c0-fb7c2621438d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 4.263162 May 18 01:38:43.842273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:39 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 4268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:43.866503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:43.913081 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d2c2a700-31f5-4451-9012-b2c20b08d294 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 4.269458 May 18 01:38:43.927220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 18/39] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:39 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 4284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:44.861568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:44.862556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:44.879620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:44.887939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:44.889216 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:44.889873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:45.182292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: .version_select at 0x7efcda122310>, body: {"keypair": {"name": "tempest-keypair-2090464693"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:45.256880 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:45.274729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:45.609923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:45.618563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:45.644946 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e0992774-d63f-4c44-9011-033a756c3821 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.856692 May 18 01:38:45.646815 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 22/40] 10.222.0.16 () {62 vars in 1199 bytes} [Tue May 18 01:38:44 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 859 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 18 01:38:45.658299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:45.660174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:45.678630 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:45.680209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:45.683551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:45.691641 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:45.740032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:45.748517 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-15817fae-69bc-4d91-9b7b-d92490a0aff9 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 0.892302 May 18 01:38:45.756765 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 19/41] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:44 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:46.434589 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:46.452289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5746898a-c33b-4b82-8751-877a3b19903a tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 0.804065 May 18 01:38:46.459919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 23/42] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:45 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:46.773379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:46.774477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:46.793427 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:46.794808 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:46.795829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:46.818412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:47.476567 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:47.478114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:47.490276 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:47.510191 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:47.511376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:47.511840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:47.737619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:47.750804 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fd2e058b-386c-44bb-b21f-c837236b96a0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 0.980883 May 18 01:38:47.768760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 20/43] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:46 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:48.107976 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:48.121539 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ff90e5fe-d026-41c6-96d2-2f658ea83cf3 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 0.649165 May 18 01:38:48.143447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:47 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:48.286503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-935830569", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6290b07a-a3d1-48f5-9bf2-47816df9c044"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:48.403891 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: .version_select at 0x7efcda091940>, body: {"keypair": {"name": "tempest-keypair-51384957"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:48.418654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] validate_networks() for [('6290b07a-a3d1-48f5-9bf2-47816df9c044', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:38:48.457375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:48.467669 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:49.011689 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:49.025998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:49.055666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-be0aab07-05b7-4190-a767-1c8b84e95c78 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.910730 May 18 01:38:49.061390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 25/45] 10.222.0.16 () {60 vars in 1158 bytes} [Tue May 18 01:38:48 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:49.536480 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-86afa988-fc55-4e59-8396-5e659f661284 req-94b910bb-20d9-40b8-9563-18e597286341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc567ad-7718-4f93-bae3-96e991f7c33c", "tag": "0ea980e2-a2f9-4752-8917-0f3f9d94d1d4"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:49.538731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:38:49.538731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:38:49.577982 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-86afa988-fc55-4e59-8396-5e659f661284 req-94b910bb-20d9-40b8-9563-18e597286341 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:49.579442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-86afa988-fc55-4e59-8396-5e659f661284 req-94b910bb-20d9-40b8-9563-18e597286341 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:49.621440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-86afa988-fc55-4e59-8396-5e659f661284 req-94b910bb-20d9-40b8-9563-18e597286341 service nova] Creating event network-changed:0ea980e2-a2f9-4752-8917-0f3f9d94d1d4 for instance ebc567ad-7718-4f93-bae3-96e991f7c33c on hv-cinder-78462 May 18 01:38:49.621978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-86afa988-fc55-4e59-8396-5e659f661284 req-94b910bb-20d9-40b8-9563-18e597286341 service nova] Acquired lock "compute-rpcapi-router" {{(pid=92948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 18 01:38:49.623138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:49.627770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:49.628967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:49.629432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:49.663568 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.compute.rpcapi [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 18 01:38:49.665696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f9298def-8090-4227-ade9-94eada8787ab None None] Releasing lock "compute-rpcapi-router" {{(pid=92948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 18 01:38:49.712059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f9298def-8090-4227-ade9-94eada8787ab None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.653815 May 18 01:38:49.717023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 26/46] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:49.729687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:49.731233 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:49.740143 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:49.740845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:49.742149 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:49.742749 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:50.378996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:50.396077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a0c86d2d-5f82-4c96-bbac-498c7ada73bf tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 0.676071 May 18 01:38:50.396731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 27/47] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:49 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:50.409859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:50.413023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:50.429960 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:50.430724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:50.438102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:50.438836 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:50.865610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:38:50.866584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:38:50.867366 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:38:50.867974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:38:50.868648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:38:50.889530 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:50.891210 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:50.893368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:50.897715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:50.976729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Getting quotas for project f1c7e3b2369f4588a3674cde01fd7d36. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:50.987686 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Getting quotas for user 47174dfb228a4e7d96b542f269e95b0d and project f1c7e3b2369f4588a3674cde01fd7d36. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:51.004130 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:38:51.006786 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:38:51.082604 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f735ee32-5caa-4975-99a4-564a8cba26b8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.123551 May 18 01:38:51.085640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 21/48] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:38:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 3127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:38:51.098447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2bce9952-aca7-445e-b79c-5605766b0d70 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:51.100979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2bce9952-aca7-445e-b79c-5605766b0d70 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:51.303515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2bce9952-aca7-445e-b79c-5605766b0d70 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:51.320824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2bce9952-aca7-445e-b79c-5605766b0d70 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1221 microversion: 2.1 time: 0.228357 May 18 01:38:51.340827 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 22/49] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:51 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1221 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:51.399065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:51.414370 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:51.415115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:51.426776 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b2db15e3-a9eb-4689-b8c4-4c05bb5e29f9 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 1.027931 May 18 01:38:51.428150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 28/50] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:50 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:51.445651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:51.446169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:51.449501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:51.451402 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:51.516656 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1661506912", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6290b07a-a3d1-48f5-9bf2-47816df9c044"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:51.614136 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] validate_networks() for [('6290b07a-a3d1-48f5-9bf2-47816df9c044', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:38:52.716250 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:52.729903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b5465291-0145-4574-9edd-665b1d7d4dbd tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 1.319560 May 18 01:38:52.742068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 23/51] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:51 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:52.747673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-cef14a1d-8410-45ef-b8bd-95a180edfdd0 req-a02094c2-bcf7-4a56-bd5c-51f2ee526263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f506f3e-df90-4b93-b6d0-2d84b3130be8", "tag": "306dd73e-3488-41c6-b1e9-b34a574b7b10"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:52.755482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:38:52.755482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:38:52.775438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-cef14a1d-8410-45ef-b8bd-95a180edfdd0 req-a02094c2-bcf7-4a56-bd5c-51f2ee526263 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:52.776148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-cef14a1d-8410-45ef-b8bd-95a180edfdd0 req-a02094c2-bcf7-4a56-bd5c-51f2ee526263 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:52.800695 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-cef14a1d-8410-45ef-b8bd-95a180edfdd0 req-a02094c2-bcf7-4a56-bd5c-51f2ee526263 service nova] Creating event network-changed:306dd73e-3488-41c6-b1e9-b34a574b7b10 for instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 on hv-cinder-78462 May 18 01:38:52.804515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-cef14a1d-8410-45ef-b8bd-95a180edfdd0 req-a02094c2-bcf7-4a56-bd5c-51f2ee526263 service nova] Acquired lock "compute-rpcapi-router" {{(pid=92949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 18 01:38:52.805950 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:52.806773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:52.807820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:52.808681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:52.834906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.compute.rpcapi [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 18 01:38:52.836433 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=92949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 18 01:38:52.887601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e6cb6fbd-94ea-4557-b0ca-896905e7f3e6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143873 May 18 01:38:52.888354 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 24/52] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:38:52.920501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:52.921316 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:52.943694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:52.947438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:52.948542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:52.949472 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:53.692263 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:38:53.693062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:38:53.693685 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:38:53.694201 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:38:53.694704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:38:53.712555 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:53.717366 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:53.718900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:53.720830 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:53.756729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Getting quotas for project f1c7e3b2369f4588a3674cde01fd7d36. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:38:53.763549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Getting quotas for user 47174dfb228a4e7d96b542f269e95b0d and project f1c7e3b2369f4588a3674cde01fd7d36. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:38:53.794615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:38:53.800561 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:38:53.892149 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-687be163-46f8-4c8a-b266-afa084816d72 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.382328 May 18 01:38:53.894978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 29/53] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:38:51 2021] POST /compute/v2.1/servers => generated 383 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 01:38:53.902487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:53.903129 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:53.939309 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:53.939780 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:53.940613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:53.941060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:54.401487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:54.421700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-335dbd52-7de5-4ef6-8426-ef9d71d98921 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 1.531446 May 18 01:38:54.422853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 25/54] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:52 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:54.436207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f2e9d53b-145a-4821-a174-3fb6365d8358 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:54.438182 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f2e9d53b-145a-4821-a174-3fb6365d8358 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:54.629726 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f2e9d53b-145a-4821-a174-3fb6365d8358 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:54.638400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f2e9d53b-145a-4821-a174-3fb6365d8358 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1222 microversion: 2.1 time: 0.214169 May 18 01:38:54.648500 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 26/55] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:54 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:54.894365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:54.908802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-88621e16-3be1-4d45-ac79-296f297f8ecc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 1.012508 May 18 01:38:54.914844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 30/56] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:53 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:55.439960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:55.441145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:55.456473 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:55.456955 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:55.457762 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:55.458397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:55.659905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:55.662598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:55.680888 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:55.681351 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:55.682146 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:55.682592 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:56.346671 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:56.361751 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e4f9d602-4bbd-4c20-9123-be320e2b0dc9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1274 microversion: 2.1 time: 0.706554 May 18 01:38:56.362334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 31/57] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:55 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1274 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:56.389969 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:56.394201 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:56.418093 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:56.423415 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:56.424597 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:56.425186 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:56.966159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:56.979732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2de9dd82-5db2-4cf0-99b9-fe039e4775e8 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 1.544505 May 18 01:38:56.985636 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 27/58] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:55 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:57.157360 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:57.170097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6cbdf069-0eb8-4b0a-8a68-ccb2cae512fc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 0.789076 May 18 01:38:57.177802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:56 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:57.381510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:57.384386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:57.405719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:57.406187 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:57.406990 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:57.407487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:58.001208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:58.001838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:58.028594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:58.029210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:58.030601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:58.031045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:58.178344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:58.188850 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-889b6321-5aa8-40c4-bf57-f084520125c0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1280 microversion: 2.1 time: 0.813244 May 18 01:38:58.195898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 28/60] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:57 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1280 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:58.215355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2022326309", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0329a854-a80f-4d3b-b599-428accfcaec5"}], "security_groups": [{"name": "tempest-securitygroup--1424862305"}], "key_name": "tempest-keypair-51384957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:38:58.823404 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] validate_networks() for [('0329a854-a80f-4d3b-b599-428accfcaec5', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:38:59.030910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:59.040488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3296960a-c21a-4f4f-b50e-004cd6dd3a77 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 1.043489 May 18 01:38:59.044009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 33/61] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:57 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:38:59.051932 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:59.064811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:59.082723 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:59.083366 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:59.085656 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:59.086289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:59.917164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:38:59.931583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9d538399-695f-4e00-a45d-300be5b006a8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1318 microversion: 2.1 time: 0.883225 May 18 01:38:59.935605 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 34/62] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:59 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1318 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:38:59.948241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:38:59.950914 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:38:59.969171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:59.972725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:38:59.981552 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:38:59.982189 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:00.345619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:00.346166 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:00.346537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:00.346958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:00.347389 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:00.362870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:00.363621 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:00.366564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:00.367335 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:00.393969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:00.400679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:00.416859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:00.419654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:00.490323 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ce6d1f45-e5e9-4292-8bf2-39faf5366716 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.293211 May 18 01:39:00.490996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 29/63] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:38:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:39:00.744719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-22f00f5b-df85-44f6-8c45-bad0c4dd2e56 req-39b75209-6f07-4b74-98ea-edd99d5a5857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc567ad-7718-4f93-bae3-96e991f7c33c", "name": "network-vif-plugged", "status": "completed", "tag": "0ea980e2-a2f9-4752-8917-0f3f9d94d1d4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:00.746926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:00.746926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:00.769347 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-22f00f5b-df85-44f6-8c45-bad0c4dd2e56 req-39b75209-6f07-4b74-98ea-edd99d5a5857 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:00.770043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-22f00f5b-df85-44f6-8c45-bad0c4dd2e56 req-39b75209-6f07-4b74-98ea-edd99d5a5857 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:00.790590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-22f00f5b-df85-44f6-8c45-bad0c4dd2e56 req-39b75209-6f07-4b74-98ea-edd99d5a5857 service nova] Creating event network-vif-plugged:0ea980e2-a2f9-4752-8917-0f3f9d94d1d4 for instance ebc567ad-7718-4f93-bae3-96e991f7c33c on hv-cinder-78462 May 18 01:39:00.797178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-22f00f5b-df85-44f6-8c45-bad0c4dd2e56 req-39b75209-6f07-4b74-98ea-edd99d5a5857 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304124 May 18 01:39:00.798494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 30/64] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:00.805148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-333290551", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9a4e49a-e6eb-464d-8878-0bb9422087bd"}], "security_groups": [{"name": "tempest-securitygroup--2142850436"}], "key_name": "tempest-keypair-2090464693", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:01.069488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] validate_networks() for [('f9a4e49a-e6eb-464d-8878-0bb9422087bd', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:39:01.106764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:01.116377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c6e676a8-8dcb-4b46-84a1-257f732cd7e2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 1.179258 May 18 01:39:01.117459 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:38:59 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:01.121993 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1782877721", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "c49dab14-84c3-441e-a7e2-c852ef7f99c5"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:01.203233 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] validate_networks() for [('c49dab14-84c3-441e-a7e2-c852ef7f99c5', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:39:02.619999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:02.620586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:02.621456 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:02.621456 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:02.621836 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:02.636064 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.636568 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.637691 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.638140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.660881 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Getting quotas for project dc6f3859cf8e4b078185ad84e62d51a3. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:02.665032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Getting quotas for user e7c7865a316b442797dbbdedf27297de and project dc6f3859cf8e4b078185ad84e62d51a3. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:02.679377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:02.681583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:02.759979 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b290fb14-55ad-4077-b864-f8381052d875 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641366 May 18 01:39:02.769178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 36/66] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:39:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:39:02.775245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:02.776059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:02.802977 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.804555 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.806007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.807135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.809040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:02.809836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:02.810556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:02.811516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:02.812460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:02.841766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.843412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.844876 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:02.846248 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:02.902755 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:02.908662 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:02.939502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:02.942032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:03.065029 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-72271c28-a3e3-4c63-aea3-a7046a7012a8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.264913 May 18 01:39:03.065583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 31/67] 10.222.0.16 () {62 vars in 1188 bytes} [Tue May 18 01:39:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 01:39:03.099223 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-3e5ca983-47df-4e54-8c9d-4f668a3e025f req-4be86247-e30f-4feb-b868-129bf5de67cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca767d8-1b78-4c0e-a024-8c965bbc81fb", "tag": "42f7a08b-e471-42b5-9f5c-ffcdcbc27e39"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:03.101658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:03.101658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:03.129297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3e5ca983-47df-4e54-8c9d-4f668a3e025f req-4be86247-e30f-4feb-b868-129bf5de67cb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:03.129795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3e5ca983-47df-4e54-8c9d-4f668a3e025f req-4be86247-e30f-4feb-b868-129bf5de67cb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:03.165934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-3e5ca983-47df-4e54-8c9d-4f668a3e025f req-4be86247-e30f-4feb-b868-129bf5de67cb service nova] Creating event network-changed:42f7a08b-e471-42b5-9f5c-ffcdcbc27e39 for instance dca767d8-1b78-4c0e-a024-8c965bbc81fb on hv-cinder-78462 May 18 01:39:03.179608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-3e5ca983-47df-4e54-8c9d-4f668a3e025f req-4be86247-e30f-4feb-b868-129bf5de67cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106604 May 18 01:39:03.183476 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 32/68] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:03.197413 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:03.199118 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:03.222917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:03.224651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:03.225547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:03.227574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:03.274334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:03.288533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-feedb957-f4fb-494f-84ab-20a52b96043b tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 0.515101 May 18 01:39:03.290587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:02 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:03.301156 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:03.302178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:03.325813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:03.326292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:03.327147 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:03.327580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:03.631037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:03.646442 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5dfe6daa-94af-4dcf-84ca-3fadc76852a4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1294 microversion: 2.1 time: 0.460757 May 18 01:39:03.659487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:03 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1294 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:04.052791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-9846af8e-9646-4eca-a705-a68e269c8cb4 req-7daaada1-02d2-4e12-b598-ee5bf8ca77eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32391b7b-257b-4f36-b726-4dfd3f0b288f", "tag": "c43ac595-ec03-4b39-9f1d-20edb0cfd8cb"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:04.054635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:04.054635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:04.066200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9846af8e-9646-4eca-a705-a68e269c8cb4 req-7daaada1-02d2-4e12-b598-ee5bf8ca77eb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.066865 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9846af8e-9646-4eca-a705-a68e269c8cb4 req-7daaada1-02d2-4e12-b598-ee5bf8ca77eb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.093217 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-9846af8e-9646-4eca-a705-a68e269c8cb4 req-7daaada1-02d2-4e12-b598-ee5bf8ca77eb service nova] Creating event network-changed:c43ac595-ec03-4b39-9f1d-20edb0cfd8cb for instance 32391b7b-257b-4f36-b726-4dfd3f0b288f on hv-cinder-78462 May 18 01:39:04.099447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:04.100234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-9846af8e-9646-4eca-a705-a68e269c8cb4 req-7daaada1-02d2-4e12-b598-ee5bf8ca77eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436875 May 18 01:39:04.101376 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 34/71] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:04.118241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b5df0337-4d26-4625-8d8f-24d12dd67ede tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1508 microversion: 2.1 time: 0.826289 May 18 01:39:04.121564 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:03 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1508 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:04.132407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:04.133381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:04.139648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:04.140643 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:04.144358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.145121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.146529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.147508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.149066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.149533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.150331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.150766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.624103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:04.642391 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-27c588e5-9f06-47ed-8af1-18bcbabce11a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1210 microversion: 2.1 time: 0.519438 May 18 01:39:04.642988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:04 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1210 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:04.660765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-987c89e7-c8e0-4022-b788-8ac1e8fd375b req-c87f08a2-94fd-4b96-8efc-bdf64d1ca7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f506f3e-df90-4b93-b6d0-2d84b3130be8", "name": "network-vif-plugged", "status": "completed", "tag": "306dd73e-3488-41c6-b1e9-b34a574b7b10"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:04.662507 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:04.662507 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:04.688777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-987c89e7-c8e0-4022-b788-8ac1e8fd375b req-c87f08a2-94fd-4b96-8efc-bdf64d1ca7c6 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.689241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-987c89e7-c8e0-4022-b788-8ac1e8fd375b req-c87f08a2-94fd-4b96-8efc-bdf64d1ca7c6 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.718878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-987c89e7-c8e0-4022-b788-8ac1e8fd375b req-c87f08a2-94fd-4b96-8efc-bdf64d1ca7c6 service nova] Creating event network-vif-plugged:306dd73e-3488-41c6-b1e9-b34a574b7b10 for instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 on hv-cinder-78462 May 18 01:39:04.726422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-987c89e7-c8e0-4022-b788-8ac1e8fd375b req-c87f08a2-94fd-4b96-8efc-bdf64d1ca7c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073212 May 18 01:39:04.727032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 40/74] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:04.742471 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:04.743484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:04.759724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.763319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:04.764524 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:04.765812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.059490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.070882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.079414 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.080818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d4adb830-1b5c-4f15-8e0a-a3b392892c86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1277 microversion: 2.20 time: 0.348009 May 18 01:39:05.085145 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 41/75] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:04 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:05.104724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:05.108754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:05.131664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.132467 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.133474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.135349 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.236201 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.268460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5f4dc367-96f8-42cf-b338-0a170405a8bc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 1.163863 May 18 01:39:05.280498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 35/76] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:04 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:05.291333 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:05.293358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:05.316658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.318748 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.322022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.325313 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.826615 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.850141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cc1b45bd-b554-49b3-bba2-095db95af487 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.568013 May 18 01:39:05.850773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:05 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:05.865048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:05.865769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:05.883754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.884228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.887096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:05.890572 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:05.922190 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:05.931267 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-915d4980-bb4f-4032-a633-05801952adbc tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 0.844775 May 18 01:39:05.931853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:05 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:06.108205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:06.109325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:06.133452 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.134844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.138609 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.140011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.350377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:06.365562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-66988143-4c01-48d8-b268-62a2a1adcd43 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1272 microversion: 2.1 time: 0.513674 May 18 01:39:06.366614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:05 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1272 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:06.373867 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db304783-0352-4c15-8302-c282c6938836"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:06.375445 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:06.384040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.384500 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.385492 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.386000 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.415395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:06.429745 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:06.431404 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:06.433703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c5669fe9-4dc1-4178-a3d0-31ca63e03489 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1351 microversion: 2.20 time: 0.329272 May 18 01:39:06.434275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 43/80] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:06 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1351 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:06.444255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:06.450145 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:06.465892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.466598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.469562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.471317 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.855859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:06.875295 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3ad02501-0e74-448d-8ae0-92941c4bd424 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 0.433514 May 18 01:39:06.876916 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 44/81] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:06 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:06.899341 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:06.901538 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:06.915673 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.916580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:06.918183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:06.918825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.241791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-47268741-f647-4a62-9cec-c17c49184325 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873564 May 18 01:39:07.242573 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 38/82] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:39:06 2021] POST /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:07.257807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:07.261002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:07.283738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:07.284399 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.285502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:07.286098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.351891 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:07.365078 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7f929064-2bb6-492b-bb1e-7cd987b30fcf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.486831 May 18 01:39:07.369994 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 45/83] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:06 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:07.384419 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:07.385114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:07.409650 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:07.414249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.417187 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:07.418933 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.879023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:07.888131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1c75a126-8b8b-4f41-80ce-5b977d999bfa tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1272 microversion: 2.1 time: 0.508842 May 18 01:39:07.898092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 46/84] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:07 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1272 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:07.902964 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-d4566c0d-3869-4ac5-9b53-aa71c68f129c req-6d22216d-ceb4-4ce5-9a13-91f9d422911f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba23ab8-adff-42c4-8703-96301fb86d53", "tag": "ff49e2eb-02d8-42cc-a8ed-70c00ecf8204"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:07.906573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:07.906573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:07.916888 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-d4566c0d-3869-4ac5-9b53-aa71c68f129c req-6d22216d-ceb4-4ce5-9a13-91f9d422911f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:07.917672 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-d4566c0d-3869-4ac5-9b53-aa71c68f129c req-6d22216d-ceb4-4ce5-9a13-91f9d422911f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:07.947217 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-d4566c0d-3869-4ac5-9b53-aa71c68f129c req-6d22216d-ceb4-4ce5-9a13-91f9d422911f service nova] Creating event network-changed:ff49e2eb-02d8-42cc-a8ed-70c00ecf8204 for instance 5ba23ab8-adff-42c4-8703-96301fb86d53 on hv-cinder-78462 May 18 01:39:07.956912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-d4566c0d-3869-4ac5-9b53-aa71c68f129c req-6d22216d-ceb4-4ce5-9a13-91f9d422911f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057322 May 18 01:39:07.959767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 47/85] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:07.974612 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:07.975648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:07.997615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:08.000095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:08.002174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:08.002868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:08.420119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:08.434252 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-36e45269-fc08-46a4-a1ef-7f54931eb150 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1315 microversion: 2.1 time: 1.190061 May 18 01:39:08.435137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 39/86] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:07 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:08.448945 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:08.450021 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:08.468763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:08.469149 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:08.469970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:08.471024 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.101508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.119249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.125422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.128479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3e388404-e45c-48df-a946-8df917a6cfe0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 1.165010 May 18 01:39:09.129607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 48/87] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:07 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:09.141036 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:09.144467 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:09.162892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:09.163378 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.166626 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:09.167119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.249355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.260898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a96d5249-1e73-44c0-8ac8-66c62582ff83 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 0.824311 May 18 01:39:09.265317 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 40/88] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:08 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:09.278582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:09.279501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:09.293777 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:09.294482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.295478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:09.296098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.885178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.901435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bde73d6d-6f95-4da0-b0a7-be8db7634025 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.634821 May 18 01:39:09.902534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 41/89] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:09 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:09.917305 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-72b20621-4374-4207-8129-1469fce66e5e req-243de3f7-4fd6-4789-aeb7-67b414a944ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca767d8-1b78-4c0e-a024-8c965bbc81fb", "name": "network-vif-plugged", "status": "completed", "tag": "42f7a08b-e471-42b5-9f5c-ffcdcbc27e39"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:09.919060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:09.919060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:09.927964 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-72b20621-4374-4207-8129-1469fce66e5e req-243de3f7-4fd6-4789-aeb7-67b414a944ca service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:09.929516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-72b20621-4374-4207-8129-1469fce66e5e req-243de3f7-4fd6-4789-aeb7-67b414a944ca service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:09.975084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-72b20621-4374-4207-8129-1469fce66e5e req-243de3f7-4fd6-4789-aeb7-67b414a944ca service nova] Creating event network-vif-plugged:42f7a08b-e471-42b5-9f5c-ffcdcbc27e39 for instance dca767d8-1b78-4c0e-a024-8c965bbc81fb on hv-cinder-78462 May 18 01:39:09.982023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-72b20621-4374-4207-8129-1469fce66e5e req-243de3f7-4fd6-4789-aeb7-67b414a944ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068507 May 18 01:39:09.983248 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:09.985457 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 42/90] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:09.996898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9f1a83ae-1d48-443e-ab9c-d19d0791d22e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.863667 May 18 01:39:10.000265 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:10.001328 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:10.003645 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 49/91] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:09 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:10.019398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.027679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.030837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.031900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.147811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:10.148506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:10.171068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.171540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.172413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.172862 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.707116 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:10.722777 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:10.731589 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:10.736014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cd6dbbe8-fa58-4875-93b9-02847a4b6335 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1502 microversion: 2.1 time: 0.748261 May 18 01:39:10.737163 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:10.737931 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 43/92] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:09 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1502 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:10.741121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f32cdd59-ecf9-46b9-adc0-79a5e17d28b4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.598009 May 18 01:39:10.743627 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 50/93] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:10 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:39:10.753591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:10.754674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:10.757298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-e0a10553-25e6-46e2-b041-75b9ab34c27d req-d45d017b-feaf-44cb-9194-70b3ae7c872e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:10.762352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:10.762352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:10.771724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.774690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.778460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.779132 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.783673 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e0a10553-25e6-46e2-b041-75b9ab34c27d req-d45d017b-feaf-44cb-9194-70b3ae7c872e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.784124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e0a10553-25e6-46e2-b041-75b9ab34c27d req-d45d017b-feaf-44cb-9194-70b3ae7c872e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.823202 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-e0a10553-25e6-46e2-b041-75b9ab34c27d req-d45d017b-feaf-44cb-9194-70b3ae7c872e service nova] Creating event network-changed:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:39:10.843467 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-e0a10553-25e6-46e2-b041-75b9ab34c27d req-d45d017b-feaf-44cb-9194-70b3ae7c872e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089212 May 18 01:39:10.844455 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 51/94] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:10.921974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:10.925319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:10.953194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.958124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:10.961068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:10.961640 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:11.383439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:11.399627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-57b5914c-29b4-4567-acd8-9fbc8718a368 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 0.659136 May 18 01:39:11.411932 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:10 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:11.418282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:11.419288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:11.431010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:11.431010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:11.431010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:11.431010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:11.545026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:11.555647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f448d866-c033-4578-8b99-1b7a6efcc633 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.639434 May 18 01:39:11.557605 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 52/96] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:10 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:11.563445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-c59d5545-9533-474a-91f0-a0a677627670 req-9740ae89-7ea7-485f-bb5f-68d9f538a438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b8bd21-b42f-4eed-a88b-2efba9c791e2", "tag": "3c888c96-2032-470a-854f-3b3a89748e06"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:11.566112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:11.566112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:11.577268 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c59d5545-9533-474a-91f0-a0a677627670 req-9740ae89-7ea7-485f-bb5f-68d9f538a438 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:11.578337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c59d5545-9533-474a-91f0-a0a677627670 req-9740ae89-7ea7-485f-bb5f-68d9f538a438 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:11.601886 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-c59d5545-9533-474a-91f0-a0a677627670 req-9740ae89-7ea7-485f-bb5f-68d9f538a438 service nova] Creating event network-changed:3c888c96-2032-470a-854f-3b3a89748e06 for instance e1b8bd21-b42f-4eed-a88b-2efba9c791e2 on hv-cinder-78462 May 18 01:39:11.611206 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-c59d5545-9533-474a-91f0-a0a677627670 req-9740ae89-7ea7-485f-bb5f-68d9f538a438 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051406 May 18 01:39:11.612706 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 53/97] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:11.761012 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:11.762141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:11.771801 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:11.772789 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:11.773793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:11.774508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:12.122148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:12.139463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6f31874f-ee29-45b3-8dd1-09ae5d4d4bc1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.725442 May 18 01:39:12.140941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 45/98] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:11 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:12.145628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-9df7ef3c-d382-41a1-807d-d4f3491a3a1b req-c223807a-df6d-4a9e-aa15-33b71933fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32391b7b-257b-4f36-b726-4dfd3f0b288f", "name": "network-vif-plugged", "status": "completed", "tag": "c43ac595-ec03-4b39-9f1d-20edb0cfd8cb"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:12.147449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:12.147449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:12.157113 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9df7ef3c-d382-41a1-807d-d4f3491a3a1b req-c223807a-df6d-4a9e-aa15-33b71933fb2e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:12.157786 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9df7ef3c-d382-41a1-807d-d4f3491a3a1b req-c223807a-df6d-4a9e-aa15-33b71933fb2e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:12.177023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-9df7ef3c-d382-41a1-807d-d4f3491a3a1b req-c223807a-df6d-4a9e-aa15-33b71933fb2e service nova] Creating event network-vif-plugged:c43ac595-ec03-4b39-9f1d-20edb0cfd8cb for instance 32391b7b-257b-4f36-b726-4dfd3f0b288f on hv-cinder-78462 May 18 01:39:12.188416 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-9df7ef3c-d382-41a1-807d-d4f3491a3a1b req-c223807a-df6d-4a9e-aa15-33b71933fb2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045982 May 18 01:39:12.189034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 46/99] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:12.290706 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:12.313840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:12.315846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:12.317373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ef66a46b-0a25-414b-87da-b0ea9f8d815b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.561766 May 18 01:39:12.318505 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 54/100] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:11 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:39:12.418948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:12.420230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:12.428221 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:12.428822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:12.429666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:12.430106 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:12.573620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:12.574194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:12.582376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:12.583150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:12.584233 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:12.584913 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.038407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:13.048036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e0211261-8cb6-4c95-944e-7ba41f26f2a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1322 microversion: 2.1 time: 0.633754 May 18 01:39:13.049514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 47/101] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:12 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:13.054567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83b8217e-daf2-4119-ad5e-aef382b6607d"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:13.055628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:13.063798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.064690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.065479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.066067 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.067038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:13.083469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fb0f0897-7c46-4af4-83e6-abfcd716ba00 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.513832 May 18 01:39:13.094502 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 55/102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:12 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:13.174337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:13.178322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:13.200799 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.201376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.202290 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.202836 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.641781 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-22221a7a-dbb4-4d9b-b971-7766dfe79561 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "POST /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590554 May 18 01:39:13.642836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 48/103] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:39:13 2021] POST /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:13.658527 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:13.667817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ab8bd3a5-0d22-4383-8b32-5d97adbe9a19 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.502823 May 18 01:39:13.669356 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 56/104] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:13 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:13.687311 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:13.688799 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:13.697970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.698738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:13.699694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:13.700471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.008933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:14.021006 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:14.022818 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:14.023994 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a2da2fa7-f9fc-406e-a94f-e022eeb0caf2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.379809 May 18 01:39:14.024589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 49/105] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:13 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:14.065868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:14.066591 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:14.078112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.079867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.080793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.084767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.101289 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:14.102170 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:14.125776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.126231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.128597 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.129483 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.423698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:14.427482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:14.437039 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-99640654-3471-491f-b48a-acc9e0cd53f8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1516 microversion: 2.1 time: 0.374768 May 18 01:39:14.437850 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2240ed66-b8ce-439a-af64-4064f3b72fa3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.340511 May 18 01:39:14.438439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 50/106] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:14 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:14.440213 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 57/107] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:14 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1516 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:14.458641 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:14.459750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:14.477884 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.478460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.479250 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.479692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.542748 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lazy-loading 'flavor' on Instance uuid 32391b7b-257b-4f36-b726-4dfd3f0b288f {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:39:14.687940 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:14.688693 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:14.708500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.708962 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.709763 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.710405 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.733970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-237d572f-b125-4c33-8d3f-87a9fb748fe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f/action" status: 200 len: 32 microversion: 2.1 time: 0.277919 May 18 01:39:14.735525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 51/108] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:14 2021] POST /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 01:39:14.748397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:14.749650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:14.765994 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.766732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:14.768340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:14.770758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.266208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:15.278302 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-14489540-a9cd-47e5-9954-4a798f6ee5a8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.595199 May 18 01:39:15.280058 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 58/109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:14 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:15.323342 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:15.325928 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:15.357223 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:15.358197 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.359029 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:15.359474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.432788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:15.453069 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d3176278-3467-4eee-9c3c-990f1a7d4fe2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.711351 May 18 01:39:15.464985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 52/110] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:14 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:15.471712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-2154ebae-ca77-4a8b-a800-e469bb6504de req-b3392ace-dac1-493f-aa93-b4d54f2f1cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba23ab8-adff-42c4-8703-96301fb86d53", "name": "network-vif-plugged", "status": "completed", "tag": "ff49e2eb-02d8-42cc-a8ed-70c00ecf8204"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:15.474290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:15.474290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:15.484519 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2154ebae-ca77-4a8b-a800-e469bb6504de req-b3392ace-dac1-493f-aa93-b4d54f2f1cf2 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:15.485287 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2154ebae-ca77-4a8b-a800-e469bb6504de req-b3392ace-dac1-493f-aa93-b4d54f2f1cf2 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.506418 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-2154ebae-ca77-4a8b-a800-e469bb6504de req-b3392ace-dac1-493f-aa93-b4d54f2f1cf2 service nova] Creating event network-vif-plugged:ff49e2eb-02d8-42cc-a8ed-70c00ecf8204 for instance 5ba23ab8-adff-42c4-8703-96301fb86d53 on hv-cinder-78462 May 18 01:39:15.513825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-2154ebae-ca77-4a8b-a800-e469bb6504de req-b3392ace-dac1-493f-aa93-b4d54f2f1cf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046945 May 18 01:39:15.515195 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 53/111] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:15.522829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:15.523843 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:15.534080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:15.535001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.536117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:15.536992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:15.973086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:15.983427 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:15.991716 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:15.992707 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8dc8ca17-10c8-40c9-a641-60ebbd561b7f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.710929 May 18 01:39:15.996502 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 59/112] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:15 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:16.023975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-948037038", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "34ad0de6-e603-440b-8c73-37173bf6aad9"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:16.125065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] validate_networks() for [('34ad0de6-e603-440b-8c73-37173bf6aad9', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:39:16.374963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:16.390266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5fae32dc-2989-496a-a2b9-6cff0cd03108 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.872965 May 18 01:39:16.391840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:15 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:16.399547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:16.401100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:16.414477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:16.415028 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:16.415916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:16.416430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:16.850050 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:16.863359 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7b2463fb-06b0-4aa9-b19d-d17651d0eebf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1362 microversion: 2.1 time: 0.469339 May 18 01:39:16.865227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 55/114] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:16 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:16.877945 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:16.879161 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:16.889731 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:16.890427 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:16.897269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:16.898021 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.126735 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:17.127712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:17.128468 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:17.128949 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:17.129376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:17.140086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.140734 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.141829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.142719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.160961 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:17.166157 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for user 51d547b6ec5747ac8cf1a52579144454 and project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:17.186543 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.188182 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:17.191893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:17.195563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-76ab3124-5b4e-4657-8283-c27211bd8540 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.328614 May 18 01:39:17.196153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 56/115] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:16 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:17.201746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:17.202523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:17.210096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.210770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.211810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.212431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.256995 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cf11ca85-2c18-4a0c-b776-6f2b452c959c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248194 May 18 01:39:17.262758 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 60/116] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:39:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:39:17.268232 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-21c8f549-3f23-4d09-9db9-1f776a389f46 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:17.270207 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-21c8f549-3f23-4d09-9db9-1f776a389f46 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:17.411551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-21c8f549-3f23-4d09-9db9-1f776a389f46 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.422203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-21c8f549-3f23-4d09-9db9-1f776a389f46 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1217 microversion: 2.1 time: 0.157616 May 18 01:39:17.422810 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 61/117] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:17 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:17.428993 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:17.429782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:17.438531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.439148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.440435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.441017 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.511128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.524206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.528924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.530744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-980dd1de-e0e9-40d8-b4ce-b1ffcb7c4e15 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.332961 May 18 01:39:17.541767 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 57/118] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:17 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:17.704504 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:17.713438 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e2007566-8518-4a2f-bd49-f806a7187fa5 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.287750 May 18 01:39:17.713913 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 62/119] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:17 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:17.883538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:17.884273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:17.893386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.893854 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:17.894654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:17.895101 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.124592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:18.135159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b5fe15b7-926b-4921-8196-80cfe4737d44 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1548 microversion: 2.1 time: 0.256213 May 18 01:39:18.135738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 58/120] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:17 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:18.153226 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:18.154453 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:18.162918 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.163382 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.164184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.164875 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.213583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:18.214212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:18.223609 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.224119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.224946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.225614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.331782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-51f7260b-92be-4d86-9754-cc381d0755c5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182745 May 18 01:39:18.339596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 63/121] 10.222.0.16 () {58 vars in 1275 bytes} [Tue May 18 01:39:18 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:18.440493 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:18.440493 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:18.459854 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.460414 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.461357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:18.461813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:18.968864 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:18.979980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-93b95cea-6a73-48d1-a68b-ec209efded47 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1269 microversion: 2.1 time: 0.544677 May 18 01:39:18.993457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:18 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1269 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:18.995744 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:18.996068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:19.026159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:19.026857 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:19.027811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:19.028429 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:19.064764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:19.075183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9498a9bc-0af4-4726-8e9e-efc2631cdec9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.866269 May 18 01:39:19.082306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:18 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:19.087435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:19.088465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:19.107969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:19.108729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:19.109721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:19.110350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:19.601766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:19.611135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:19.612678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:19.613761 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3f2fabcd-9b1c-4059-8b8b-c85119310075 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.627648 May 18 01:39:19.614317 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 65/124] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:18 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:19.625175 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:19.634306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9c639f51-8738-4768-ac17-c4242baecd7b tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.550513 May 18 01:39:19.634624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-c706f8c6-bba3-4ed3-b5bb-d35e1d331818 req-7f0afd84-bf7d-46ba-8606-d1179c552931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "name": "network-vif-plugged", "status": "completed", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:19.635730 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 60/125] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:19 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:19.637696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:19.637696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:19.649277 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c706f8c6-bba3-4ed3-b5bb-d35e1d331818 req-7f0afd84-bf7d-46ba-8606-d1179c552931 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:19.649819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c706f8c6-bba3-4ed3-b5bb-d35e1d331818 req-7f0afd84-bf7d-46ba-8606-d1179c552931 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:19.667180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-c706f8c6-bba3-4ed3-b5bb-d35e1d331818 req-7f0afd84-bf7d-46ba-8606-d1179c552931 service nova] Creating event network-vif-plugged:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:39:19.672222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-c706f8c6-bba3-4ed3-b5bb-d35e1d331818 req-7f0afd84-bf7d-46ba-8606-d1179c552931 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056551 May 18 01:39:19.673492 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 66/126] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:20.004279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:20.005067 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:20.014232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.014937 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.015930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.017282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.100032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:20.101032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:20.110241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.111004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.112169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.112831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.349757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:20.369011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-73b901db-7710-4fab-92e0-dd2b2c6a4708 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1275 microversion: 2.1 time: 0.367229 May 18 01:39:20.371132 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 61/127] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:19 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1275 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:20.466242 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:20.487541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c9dd0706-1e55-4bde-abd1-5620556ee5a6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.391969 May 18 01:39:20.504771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:20 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:20.632259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:20.633179 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:20.651431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.652040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.655767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:20.656425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.656983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.657521 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:20.669967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.673067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:20.674108 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:20.675507 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:21.309684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:21.320487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-449673c8-35ac-44f2-bb60-24f44d36d800 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.670818 May 18 01:39:21.321211 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 68/129] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:20 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:21.326394 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:21.327610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:21.335199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:21.335861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:21.336670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:21.337107 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:21.498526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:21.508593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:21.510297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:21.511731 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-34790e37-396e-4373-82ea-8f98308917a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.883907 May 18 01:39:21.522232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 62/130] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:20 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:21.527302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-93a2877b-31f0-4654-9a76-83cc1ab47120 req-da311c7f-74c2-4cc9-bcd6-8ff17f87b075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba23ab8-adff-42c4-8703-96301fb86d53", "tag": "ff49e2eb-02d8-42cc-a8ed-70c00ecf8204"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:21.529665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:21.529665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:21.538187 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-93a2877b-31f0-4654-9a76-83cc1ab47120 req-da311c7f-74c2-4cc9-bcd6-8ff17f87b075 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:21.538630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-93a2877b-31f0-4654-9a76-83cc1ab47120 req-da311c7f-74c2-4cc9-bcd6-8ff17f87b075 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:21.555271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-93a2877b-31f0-4654-9a76-83cc1ab47120 req-da311c7f-74c2-4cc9-bcd6-8ff17f87b075 service nova] Creating event network-changed:ff49e2eb-02d8-42cc-a8ed-70c00ecf8204 for instance 5ba23ab8-adff-42c4-8703-96301fb86d53 on hv-cinder-78462 May 18 01:39:21.560285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-93a2877b-31f0-4654-9a76-83cc1ab47120 req-da311c7f-74c2-4cc9-bcd6-8ff17f87b075 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036492 May 18 01:39:21.561219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 63/131] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:21.566424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:21.567123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:21.574652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:21.575107 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:21.576728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:21.576889 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.083344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:22.094360 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3cb5eb74-20a3-4ed9-8a6a-6a563567b50c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.531931 May 18 01:39:22.104685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 64/132] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:21 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:22.111350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:22.112933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:22.121356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.121938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.124018 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.124823 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.492273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:22.501755 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8689b5f5-110f-4866-9158-4c3bb6c57f0f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.395697 May 18 01:39:22.502401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 65/133] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:22 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:22.511208 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-69ad350e-de2b-45d5-ae06-c61bf587ccc3 req-127bfb09-92a7-4ac0-a065-9cd77fab0dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b8bd21-b42f-4eed-a88b-2efba9c791e2", "name": "network-vif-plugged", "status": "completed", "tag": "3c888c96-2032-470a-854f-3b3a89748e06"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:22.514016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:22.514016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:22.522897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-69ad350e-de2b-45d5-ae06-c61bf587ccc3 req-127bfb09-92a7-4ac0-a065-9cd77fab0dbb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.523345 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-69ad350e-de2b-45d5-ae06-c61bf587ccc3 req-127bfb09-92a7-4ac0-a065-9cd77fab0dbb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.539764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-69ad350e-de2b-45d5-ae06-c61bf587ccc3 req-127bfb09-92a7-4ac0-a065-9cd77fab0dbb service nova] Creating event network-vif-plugged:3c888c96-2032-470a-854f-3b3a89748e06 for instance e1b8bd21-b42f-4eed-a88b-2efba9c791e2 on hv-cinder-78462 May 18 01:39:22.545520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-69ad350e-de2b-45d5-ae06-c61bf587ccc3 req-127bfb09-92a7-4ac0-a065-9cd77fab0dbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039820 May 18 01:39:22.546155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 66/134] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:22.551234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:22.551931 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:22.559753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.560257 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.561188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.561626 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.771724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:22.779827 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a44557a5-21bf-4fab-8bc0-04cc6800653d tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.232561 May 18 01:39:22.780415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:22 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:22.784715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-28bbc034-6774-420b-ac80-f0f5079c7e32 req-c251d719-6f1e-41b8-99b3-d683a7729aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9", "tag": "6c6c3bcf-49b7-40fe-b685-3821a3ea13b4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:22.786200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:22.786200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:22.793798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-28bbc034-6774-420b-ac80-f0f5079c7e32 req-c251d719-6f1e-41b8-99b3-d683a7729aa7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.794207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-28bbc034-6774-420b-ac80-f0f5079c7e32 req-c251d719-6f1e-41b8-99b3-d683a7729aa7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.812141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-28bbc034-6774-420b-ac80-f0f5079c7e32 req-c251d719-6f1e-41b8-99b3-d683a7729aa7 service nova] Creating event network-changed:6c6c3bcf-49b7-40fe-b685-3821a3ea13b4 for instance 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 on hv-cinder-78462 May 18 01:39:22.816803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-28bbc034-6774-420b-ac80-f0f5079c7e32 req-c251d719-6f1e-41b8-99b3-d683a7729aa7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035199 May 18 01:39:22.817494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 68/136] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:22.822709 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:22.823465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:22.831814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.832274 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:22.833082 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:22.833523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.046886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:23.055619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:23.057294 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:23.058387 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a3ab8161-d1c1-46d0-bf5b-3801fbcd4b09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.239733 May 18 01:39:23.058947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 69/137] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:22 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:23.110922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:23.111635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:23.118884 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.119331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.120098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.120560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.315523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:23.323763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-65ce3b97-80ea-434d-b28a-3cb5c774897a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.216523 May 18 01:39:23.324348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 70/138] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:23 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:23.518784 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:23.519411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:23.526601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.527133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.527996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.529046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.728586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:23.736965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-16500067-ac58-4398-aa4c-b41974e89910 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.221915 May 18 01:39:23.737727 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:23 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:23.796412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:23.797063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:23.804312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.804780 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:23.805552 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:23.805991 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.151463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:24.159849 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2c838fe5-e2bc-4b0c-af8a-c32b25ce2337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.368086 May 18 01:39:24.160458 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 72/140] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:23 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:24.164824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:24.165439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:24.173066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.173520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.174300 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.174744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.375890 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:24.384538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:24.386082 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:24.387171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8ce18a15-396d-4a0e-915f-7df36246f80d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1407 microversion: 2.20 time: 0.225781 May 18 01:39:24.387732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 73/141] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:24 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:24.391944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:24.392575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:24.399370 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.399828 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.400629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.401075 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.599146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:24.607200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7d352af6-3408-45a6-a00a-5626acf183c3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.218503 May 18 01:39:24.607766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 74/142] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:24 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:24.725838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6a7c797f-2597-43bf-910e-f39652a3a2c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 3.402987 May 18 01:39:24.726392 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:21 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 3404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:24.754650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:24.755312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:24.763933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.764516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:24.765307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:24.765752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.104238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:25.123410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7875dfee-5168-48be-b389-4c9693bf0e6f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.369045 May 18 01:39:25.139203 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 75/144] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:24 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:25.177506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:25.178128 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:25.195521 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.196200 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.207485 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.208015 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.406331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:25.407172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:25.416020 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.417302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.418143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.418667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.430071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:25.439403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9041b689-2f97-402d-accb-6a9013033b3f tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.266453 May 18 01:39:25.448758 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 70/145] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:25 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:25.625041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:25.625853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:25.634396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.635601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.636938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.637387 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.734534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:25.744319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:25.746331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:25.749084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6d333a4a-ba4b-445e-b7bb-4700f424f9a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1600 microversion: 2.20 time: 0.347308 May 18 01:39:25.763421 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 76/146] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:39:25 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1600 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:39:25.769393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:25.770954 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:25.780557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.781235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.782181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.783358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.934243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3d6df05c-3e2b-42d7-a5fc-d088f9a098e3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.169008 May 18 01:39:25.935557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 77/147] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:25 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:25.941691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:25.942353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:25.967599 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.968078 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:25.968911 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:25.971498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.073625 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:26.083446 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f98f5ff3-6831-4ef5-b45c-f9e3f6dd632d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.462645 May 18 01:39:26.084021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 71/148] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:25 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:26.142137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:26.143088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:26.153339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.154084 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.174275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.175087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.205169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f3c5cecb-bf18-47eb-ac14-81653ce6091f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.266980 May 18 01:39:26.214822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 78/149] 10.222.0.16 () {60 vars in 1316 bytes} [Tue May 18 01:39:25 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:26.457708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:26.458564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:26.478122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.483866 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.487697 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.488270 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.543296 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:26.558175 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-eef514df-0501-4ba6-adcf-b3a3e53625df tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.419031 May 18 01:39:26.568234 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 72/150] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:26 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:26.576994 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:26.577867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:26.586996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.587931 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.589543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.590314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.701087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:39:26.912895 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:26.936181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-863f2c96-b101-4093-be00-afdd2d3a497c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1314 microversion: 2.1 time: 0.482412 May 18 01:39:26.936788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 79/151] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:26 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:26.940047 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-25209ce4-f604-4fb2-a06e-920cae6450fa tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 204 len: 0 microversion: 2.1 time: 0.372357 May 18 01:39:26.942569 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 73/152] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:39:26 2021] DELETE /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:39:26.951453 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:26.953239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:26.955846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:26.957079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:26.966328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.966999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.968011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.968599 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.972611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.973368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:26.974325 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:26.975556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.089950 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a70b6781-006a-4e50-aaa6-e3c4dc06a92c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.142523 May 18 01:39:27.093962 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 74/153] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:26 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:27.101407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:27.102565 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:27.110915 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.111468 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.112384 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.113139 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.308803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:27.326572 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c15a2ab0-d478-45bd-addc-bad573fca0a5 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1554 microversion: 2.1 time: 0.382158 May 18 01:39:27.327676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:26 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1554 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:27.387867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:27.400410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-16a0e7d0-a54b-45d1-a198-f1deeac03813 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.302802 May 18 01:39:27.401298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:27 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:27.576169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:27.576816 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:27.586060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.586600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.587754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.588258 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.867599 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:27.875924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1ed6668c-cb35-44d0-a6d4-fe187cdf66fa tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.303510 May 18 01:39:27.876569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:27 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:27.954887 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:27.955470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:27.964052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.964538 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:27.965327 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:27.966462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.102719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:28.104684 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:28.114755 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.115579 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.116740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.117522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.190821 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:28.200250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-48900fb0-7fb3-4f52-95ee-f404b30d8e4e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1499 microversion: 2.1 time: 0.250681 May 18 01:39:28.201332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:27 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1499 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:28.206829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:28.207822 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:28.216758 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.217476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.218577 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.218693 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.256699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e13052d2-8909-44a5-9301-bec5337e59cb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.158393 May 18 01:39:28.260749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 82/158] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:28 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 01:39:28.267717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-d97722d4-7264-4552-867c-b242ad943cd6 req-dec2575f-d1a2-4584-a5f0-500613b0737e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:28.269468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:28.269468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:28.282548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d97722d4-7264-4552-867c-b242ad943cd6 req-dec2575f-d1a2-4584-a5f0-500613b0737e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.283377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d97722d4-7264-4552-867c-b242ad943cd6 req-dec2575f-d1a2-4584-a5f0-500613b0737e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.302314 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-d97722d4-7264-4552-867c-b242ad943cd6 req-dec2575f-d1a2-4584-a5f0-500613b0737e service nova] Creating event network-changed:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:39:28.306910 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-d97722d4-7264-4552-867c-b242ad943cd6 req-dec2575f-d1a2-4584-a5f0-500613b0737e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044503 May 18 01:39:28.307509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 83/159] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:28.344975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:28.345856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:28.353980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.354431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.355207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.355642 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.369082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5472fe89-1d15-48c2-844d-bbf422fae927 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.165995 May 18 01:39:28.370309 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 77/160] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:28 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:28.420703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:28.422053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:28.451142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.451614 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.452451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.452893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.656899 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:28.677422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0e0f70e8-238e-49d5-a034-61421a2f8f66 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1554 microversion: 2.1 time: 0.337547 May 18 01:39:28.691056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 84/161] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:28 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1554 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:28.767615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:28.782652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-bce5cada-8cb2-4e43-ab3c-cd937299197c tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.367451 May 18 01:39:28.784272 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 78/162] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:28 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:28.893408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:28.894082 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:28.901831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.902612 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:28.903746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:28.904561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.180146 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:29.180780 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:29.190198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.190678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.191508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.192046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.267963 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:39:29.347938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:29.361920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9f7febc2-3ff8-48cf-8e1b-6c49329ec9b4 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.472012 May 18 01:39:29.362521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 85/163] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:28 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:29.383204 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:29.384150 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:29.401989 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.402658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.404885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.406636 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.429177 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7863c845-f64c-46cb-8029-7f5e8118c8c7 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 204 len: 0 microversion: 2.1 time: 0.252550 May 18 01:39:29.433867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 79/164] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:39:29 2021] DELETE /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:39:29.447559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:29.449178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:29.481348 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.482045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.483633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.484216 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.601931 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-476d3e39-9df5-4cf6-be55-adbfd3216d52 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.228878 May 18 01:39:29.602582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 86/165] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:29 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:29.611659 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:29.612497 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-84fe5ce8-16fe-4a57-9519-3d878f412a36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.175158 May 18 01:39:29.615920 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 80/166] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:29 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:29.616066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:29.638847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.639305 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.640115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.640584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.702013 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:29.704390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:29.725859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.726242 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:29.727053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:29.727492 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:30.395363 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:30.407832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1ea7fc4f-07eb-4cb5-b11e-49c17df0ba91 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1505 microversion: 2.1 time: 0.800388 May 18 01:39:30.412898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:29 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:30.421403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:30.422032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:30.429667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:30.430352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:30.431293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:30.431874 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:30.433687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:30.449816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-db5cfc1e-2f7a-4b61-bc94-debced242775 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1554 microversion: 2.1 time: 0.754801 May 18 01:39:30.450573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 81/168] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:29 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1554 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:30.455125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:30.455742 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:30.483892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:30.484379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:30.485271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:30.485601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.188047 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:31.195724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:31.198381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2d1b3467-02f4-4415-9dc8-d1832daabdc0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.746579 May 18 01:39:31.199551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:30 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:31.204817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:31.205837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-547f040c-f86c-48e4-a9b2-4c8a1aa55203 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.791657 May 18 01:39:31.206343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:31.215135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 88/170] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:30 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:31.215135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:31.215135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:31.228105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.228779 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.229628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.229900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.230405 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.230652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.232036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.232618 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.352196 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-82a769f3-ee86-42f2-aa08-66f93c52d194 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.151103 May 18 01:39:31.354448 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 83/171] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:31 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:31.378172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6a7a9d62-4310-4879-a86b-5b2f343f0536 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.169845 May 18 01:39:31.381300 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 89/172] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:31 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:31.431872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:31.433258 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:31.445092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.446335 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.447411 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.448105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.468163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:31.469530 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:31.484532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.485740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.487261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.488897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.755664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:31.767996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-06bf0df7-f17a-42e5-893a-72aa56d74d60 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1512 microversion: 2.1 time: 0.304317 May 18 01:39:31.780274 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 90/173] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:31 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:31.785613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-f450befc-ac79-407d-9f4d-373ba09e9c81 req-dd5137cb-1e7a-448e-b3ef-2e14c8f6c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f506f3e-df90-4b93-b6d0-2d84b3130be8", "name": "network-vif-deleted", "tag": "306dd73e-3488-41c6-b1e9-b34a574b7b10"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:31.787266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:31.787266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:31.805147 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-f450befc-ac79-407d-9f4d-373ba09e9c81 req-dd5137cb-1e7a-448e-b3ef-2e14c8f6c2be service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.814463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-f450befc-ac79-407d-9f4d-373ba09e9c81 req-dd5137cb-1e7a-448e-b3ef-2e14c8f6c2be service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:31.844630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-f450befc-ac79-407d-9f4d-373ba09e9c81 req-dd5137cb-1e7a-448e-b3ef-2e14c8f6c2be service nova] Creating event network-vif-deleted:306dd73e-3488-41c6-b1e9-b34a574b7b10 for instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 on hv-cinder-78462 May 18 01:39:31.861537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-f450befc-ac79-407d-9f4d-373ba09e9c81 req-dd5137cb-1e7a-448e-b3ef-2e14c8f6c2be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088751 May 18 01:39:31.862433 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 91/174] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:31.928871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:31.938673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-1e7e1cea-e73b-4df9-b1b6-8458b16c5150 req-cc00a6ab-cd5b-41ae-a961-38b003e43c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9", "name": "network-vif-plugged", "status": "completed", "tag": "6c6c3bcf-49b7-40fe-b685-3821a3ea13b4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:31.941158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:31.941158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:31.954977 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-85703e54-5548-4470-88a8-8dadc1103a16 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1505 microversion: 2.1 time: 0.526604 May 18 01:39:31.957325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 84/175] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:31 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:31.972124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-1e7e1cea-e73b-4df9-b1b6-8458b16c5150 req-cc00a6ab-cd5b-41ae-a961-38b003e43c25 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:31.972598 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-1e7e1cea-e73b-4df9-b1b6-8458b16c5150 req-cc00a6ab-cd5b-41ae-a961-38b003e43c25 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.000164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-1e7e1cea-e73b-4df9-b1b6-8458b16c5150 req-cc00a6ab-cd5b-41ae-a961-38b003e43c25 service nova] Creating event network-vif-plugged:6c6c3bcf-49b7-40fe-b685-3821a3ea13b4 for instance 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 on hv-cinder-78462 May 18 01:39:32.007440 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-1e7e1cea-e73b-4df9-b1b6-8458b16c5150 req-cc00a6ab-cd5b-41ae-a961-38b003e43c25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073580 May 18 01:39:32.011193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 92/176] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:32.231573 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:32.232356 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:32.233169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:32.236387 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:32.254078 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.255426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.255867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.257145 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.257649 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.258469 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.259304 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.259749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.660643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:32.670069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-adb71a76-7636-4d7e-9679-facec5afd911 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.458324 May 18 01:39:32.671221 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:32 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:32.672080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:32.676760 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:32.678270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:32.686717 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.687382 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.687831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7ad6feca-3a41-4caf-813d-af9664146a04 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1317 microversion: 2.1 time: 0.467777 May 18 01:39:32.688453 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:32 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:32.696968 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:32.697450 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.697559 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:32.698365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.708468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.708917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.709896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.710539 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.896877 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-044c372d-315f-4d1c-9be8-6335bbefb35e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.206721 May 18 01:39:32.898773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 94/179] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:32 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:32.905054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-390a130c-5230-47d4-9f32-cab238ec363c req-0f4b480f-0f89-4545-846d-0d731727644a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b8bd21-b42f-4eed-a88b-2efba9c791e2", "name": "network-vif-deleted", "tag": "3c888c96-2032-470a-854f-3b3a89748e06"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:32.909230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:32.909230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:32.933631 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-390a130c-5230-47d4-9f32-cab238ec363c req-0f4b480f-0f89-4545-846d-0d731727644a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:32.934705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-390a130c-5230-47d4-9f32-cab238ec363c req-0f4b480f-0f89-4545-846d-0d731727644a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:32.963063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-390a130c-5230-47d4-9f32-cab238ec363c req-0f4b480f-0f89-4545-846d-0d731727644a service nova] Creating event network-vif-deleted:3c888c96-2032-470a-854f-3b3a89748e06 for instance e1b8bd21-b42f-4eed-a88b-2efba9c791e2 on hv-cinder-78462 May 18 01:39:32.972260 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-390a130c-5230-47d4-9f32-cab238ec363c req-0f4b480f-0f89-4545-846d-0d731727644a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071412 May 18 01:39:32.973342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 95/180] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:32.987546 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:32.988725 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:33.004014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.008760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.010010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.010830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.057193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-80b50276-b5fd-4c5f-b586-8750713a27d7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.384310 May 18 01:39:33.059526 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 86/181] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:32 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:33.066957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:33.067715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:33.085628 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.086081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.086865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.087553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.096608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.097390 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.098058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lazy-loading 'fault' on Instance uuid 2f506f3e-df90-4b93-b6d0-2d84b3130be8 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:39:33.164399 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.164847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5039f9f63f584c319b63362df5284995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822df35a65f454ba97b1301b17f8b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:33.164989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.165370 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lazy-loading 'fault' on Instance uuid e1b8bd21-b42f-4eed-a88b-2efba9c791e2 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:39:33.173479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2d9a1852-00aa-4f7e-bfce-14794b3e262f tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 200 len: 1305 microversion: 2.1 time: 0.198702 May 18 01:39:33.174839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 96/182] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:32 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 1305 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:33.231350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:33.240180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3b465738-d294-462e-8f17-8d31551c343a tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 200 len: 1304 microversion: 2.1 time: 0.180516 May 18 01:39:33.241051 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 87/183] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:33 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 1304 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:33.688232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:33.689475 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:33.697991 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.703919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:33.705212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:33.709541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.711332 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.712157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.720012 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.720621 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:33.721651 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:33.722402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.025343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:34.037064 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0b836d05-ee4f-4d6f-abe8-a0cbc99b5124 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1508 microversion: 2.1 time: 0.337372 May 18 01:39:34.037644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 88/184] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:33 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:34.050784 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:34.052436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.062463 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.063484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.064699 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.065219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:34.065603 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.075715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-be9f8580-b71c-4475-87e4-6207dc79a6ab tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.392221 May 18 01:39:34.085682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 97/185] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:33 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:34.091484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db304783-0352-4c15-8302-c282c6938836"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:34.092714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.100675 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.101128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.102125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.102827 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.223757 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f70e5a92-48ce-4f57-8eb9-220ce6373300 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.177695 May 18 01:39:34.226853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 89/186] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:34 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:34.229629 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:34.230545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.238876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.239345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.240217 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.240930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.301525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Invalid volume: volume db304783-0352-4c15-8302-c282c6938836 is already attached to instances: ebc567ad-7718-4f93-bae3-96e991f7c33c May 18 01:39:34.302142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 400 to user: Invalid volume: volume db304783-0352-4c15-8302-c282c6938836 is already attached to instances: ebc567ad-7718-4f93-bae3-96e991f7c33c {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:39:34.302986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8b8e24b2-28ba-42e3-9652-277b9705c7d6 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216131 May 18 01:39:34.303614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 98/187] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:39:34 2021] POST /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9/os-volume_attachments => generated 174 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 01:39:34.324090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:34.325362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.334017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.334933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.335732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.336180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.370617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9729d714-dfd4-484c-a41f-0dd6f9c07cdd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 14 microversion: 2.1 time: 0.140360 May 18 01:39:34.370617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 90/188] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:34 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:34.376601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:34.377322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: e1b8bd21-b42f-4eed-a88b-2efba9c791e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.386410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.386877 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.389046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.389549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.413567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] HTTP exception thrown: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. May 18 01:39:34.414193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Returning 404 to user: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:39:34.415054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4b5dcc4d-e119-4918-adbd-2eb7280eaef2 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 404 len: 111 microversion: 2.1 time: 0.110598 May 18 01:39:34.424760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 99/189] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:34 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:39:34.453940 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] HTTP exception thrown: Instance e1b8bd21-b42f-4eed-a88b-2efba9c791e2 could not be found. May 18 01:39:34.454495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Returning 404 to user: Instance e1b8bd21-b42f-4eed-a88b-2efba9c791e2 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:39:34.455344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-bf542fdb-ab40-49bb-837a-adba0d2d1ff3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2" status: 404 len: 111 microversion: 2.1 time: 0.087094 May 18 01:39:34.455911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 91/190] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:34 2021] GET /compute/v2.1/servers/e1b8bd21-b42f-4eed-a88b-2efba9c791e2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:39:34.511853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:34.513174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:34.521702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.521702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.522004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:34.522296 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:34.584162 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-836598055", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "c49dab14-84c3-441e-a7e2-c852ef7f99c5"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:34.676267 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] validate_networks() for [('c49dab14-84c3-441e-a7e2-c852ef7f99c5', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:39:34.755743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lazy-loading 'services' on Instance uuid ebc567ad-7718-4f93-bae3-96e991f7c33c {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:39:34.924886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3acc38d2-b45d-41de-bb99-42c42896ec55 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c/os-volume_attachments/db304783-0352-4c15-8302-c282c6938836" status: 202 len: 0 microversion: 2.1 time: 0.416470 May 18 01:39:34.928987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 100/191] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:39:34 2021] DELETE /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c/os-volume_attachments/db304783-0352-4c15-8302-c282c6938836 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:35.093661 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:35.094377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:35.111334 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.111794 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.112629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.113072 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.411825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:35.412436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:35.412924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:35.413559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:35.413978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:35.434580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.435193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.436190 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.436674 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.470950 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Getting quotas for project dc6f3859cf8e4b078185ad84e62d51a3. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:35.476510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Getting quotas for user e7c7865a316b442797dbbdedf27297de and project dc6f3859cf8e4b078185ad84e62d51a3. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:35.480486 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:35.488193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:35.490664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:35.491681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-601fad67-c8df-45bd-84c2-8ca1484e640b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.402078 May 18 01:39:35.502787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 101/192] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:35 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:35.507534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:35.508629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:35.532759 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.533327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.534273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.536394 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.545530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a5676e41-5b6d-42a0-9346-74710a63eb22 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964630 May 18 01:39:35.551228 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 92/193] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:39:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:39:35.554844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:35.555944 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:35.566160 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.566624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.567488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:35.568095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:35.687385 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-014ed372-4a33-45c0-8e95-cbec90be9b36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.183141 May 18 01:39:35.690501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 102/194] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:35 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:35.694729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-68a010d1-631d-4dd7-a41e-1a1d71b9eabc tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:35.696687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-68a010d1-631d-4dd7-a41e-1a1d71b9eabc tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:35.729743 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3065b56b-4170-414f-8e51-ce62220681c2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 6257 microversion: 2.1 time: 0.180753 May 18 01:39:35.730344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 93/195] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:35 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 6257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:35.782528 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-68a010d1-631d-4dd7-a41e-1a1d71b9eabc tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:35.792196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-68a010d1-631d-4dd7-a41e-1a1d71b9eabc tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1213 microversion: 2.1 time: 0.102372 May 18 01:39:35.794218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 103/196] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:35 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:36.251506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:36.252446 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:36.264122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.264991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.266140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.266910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.319608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1902550700", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "34ad0de6-e603-440b-8c73-37173bf6aad9"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:36.343435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] HTTP exception thrown: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. May 18 01:39:36.344318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Returning 404 to user: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:39:36.345321 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e6d690a4-0262-43e8-9a20-b1fabc2f871d tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 404 len: 111 microversion: 2.1 time: 0.100400 May 18 01:39:36.349284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 94/197] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:39:36 2021] DELETE /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:39:36.357155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:36.358102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] [instance: 2f506f3e-df90-4b93-b6d0-2d84b3130be8] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:36.368726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.370018 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.371194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.373749 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.410785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] validate_networks() for [('34ad0de6-e603-440b-8c73-37173bf6aad9', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:39:36.441092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] HTTP exception thrown: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. May 18 01:39:36.441698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] Returning 404 to user: Instance 2f506f3e-df90-4b93-b6d0-2d84b3130be8 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:39:36.442603 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-524803c5-38e5-40d1-8986-0b0ac9126a34 tempest-DeleteServersTestJSON-27081668 tempest-DeleteServersTestJSON-27081668-project] 10.222.0.16 "GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8" status: 404 len: 111 microversion: 2.1 time: 0.092150 May 18 01:39:36.443451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 95/198] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:36 2021] GET /compute/v2.1/servers/2f506f3e-df90-4b93-b6d0-2d84b3130be8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:39:36.510787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:36.511421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:36.519266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.519720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.520545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.520990 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.913304 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:36.928878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a748c81b-ea7a-4ad3-a0bc-2a70f3519fa3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.421375 May 18 01:39:36.929721 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 96/199] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:36 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:36.935375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:36.936706 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:36.944388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.945121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:36.946874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:36.947865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:37.348840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:39:37.349316 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:39:37.349781 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:39:37.350427 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:39:37.350904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:39:37.361425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:37.361913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:37.363016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:37.363531 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:37.383451 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:39:37.392634 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for user 51d547b6ec5747ac8cf1a52579144454 and project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:39:37.408596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:39:37.410941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:39:37.459445 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ad5c7548-e7f3-446e-a15c-0061644eea3a tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143704 May 18 01:39:37.460102 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 104/200] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:39:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:39:37.465318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:37.467412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:37.486450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:37.487353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:37.488522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:37.490749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.405011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-644165bc-a3df-4907-9342-fbf440d6d285 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 2.473203 May 18 01:39:39.405696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 97/201] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:36 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:39.411135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:39.412142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:39.422411 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.423274 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.424363 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-def41475-89e2-428c-b2c1-bd01c42055ad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 18356 microversion: 2.1 time: 1.962712 May 18 01:39:39.424989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.425104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 105/202] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:37 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 18356 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:39.425793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.430349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:39.431180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:39.446342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.446715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.447503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.447939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.652830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:39.663286 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1c123e5e-4080-4fa6-8b63-6b7c9255d35d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1222 microversion: 2.1 time: 0.237021 May 18 01:39:39.665591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 106/203] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:39 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:39.670580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:39.672540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:39.673569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:39.682356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.682821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.683834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:39.684759 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:39.686871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-aba7f1f8-c6e3-4080-888e-4157389d33f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1265 microversion: 2.1 time: 0.279398 May 18 01:39:39.688134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 98/204] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:39 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:39.920389 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:39.929953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c3f89a39-dca2-49f5-982a-2aedebb2ffe3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.262833 May 18 01:39:39.930602 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 107/205] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:39 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:40.417251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:40.419352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:40.433120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.436080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:40.437155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:40.439095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.442797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.443437 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.454428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.454894 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.458448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.458935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.629981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8612759d-83db-4dd2-bbfb-90d713c31e9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.217180 May 18 01:39:40.633597 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 99/206] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:40 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:40.652771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ba1afe5c-cab7-415e-b3ec-9a904cb81e42 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 19342 microversion: 2.1 time: 0.220825 May 18 01:39:40.655261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 108/207] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:40 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 19342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:39:40.685261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:40.686183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:40.706721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:40.707592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:40.715281 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.718728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.719676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.721894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.737999 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.739514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:40.740650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:40.741222 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.261421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:41.276286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e154474e-481e-4b68-81d7-1a61261193b5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1288 microversion: 2.1 time: 0.595569 May 18 01:39:41.277256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 100/208] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:40 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1288 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:41.289434 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:41.289694 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:41.318381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.318850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.319698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.320210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.654150 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:41.665816 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c75b5ede-e253-42bc-a667-e3ef59b36b55 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.963357 May 18 01:39:41.676648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 109/209] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:40 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:41.683047 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:41.686456 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:41.708470 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.709244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.710262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.710904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.826138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-83ca9cfe-def5-47ba-93f6-79e49cf6aee5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 14 microversion: 2.20 time: 0.147581 May 18 01:39:41.826928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 110/210] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:41 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:41.833173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:41.834188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:41.843343 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.843979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.844986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:41.845422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:41.967621 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-296bb6b7-bafd-4a70-b67b-a898f4dee8f0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 21790 microversion: 2.1 time: 0.136620 May 18 01:39:41.973481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 111/211] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:41 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 21790 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:42.000013 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:42.014090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1bf1d3f2-ae7c-4cb8-a724-485ab0010829 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.735908 May 18 01:39:42.014684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 101/212] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:41 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:42.295135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:42.295853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:42.304613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:42.305463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:42.306446 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:42.307100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:42.528105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-f685e7e4-d3b6-4ebf-878a-92c073ea47a8 req-a42e63fe-bc4c-4edb-9db3-8c08c7b37e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28643b97-a331-4302-b5f5-9fe7c405176e", "tag": "29f9517c-823f-4646-ba1a-55881c81a4f6"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:42.530067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:42.530067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:39:42.540384 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-f685e7e4-d3b6-4ebf-878a-92c073ea47a8 req-a42e63fe-bc4c-4edb-9db3-8c08c7b37e67 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:42.541082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-f685e7e4-d3b6-4ebf-878a-92c073ea47a8 req-a42e63fe-bc4c-4edb-9db3-8c08c7b37e67 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:42.561661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-f685e7e4-d3b6-4ebf-878a-92c073ea47a8 req-a42e63fe-bc4c-4edb-9db3-8c08c7b37e67 service nova] Creating event network-changed:29f9517c-823f-4646-ba1a-55881c81a4f6 for instance 28643b97-a331-4302-b5f5-9fe7c405176e on hv-cinder-78462 May 18 01:39:42.566709 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-f685e7e4-d3b6-4ebf-878a-92c073ea47a8 req-a42e63fe-bc4c-4edb-9db3-8c08c7b37e67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042867 May 18 01:39:42.567942 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 102/213] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:42.689142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:42.689865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:42.703065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:42.703533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:42.704352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:42.704808 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.013372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:43.029507 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9188c977-743a-4927-8cd4-70ab9ed6befe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.739423 May 18 01:39:43.030426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 112/214] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:42 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:43.042644 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:43.043875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:43.056703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.057455 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.058973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.059788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.169769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7d0f7fb3-6c1b-4d42-ba05-b206739db8b2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 247 microversion: 2.20 time: 0.137897 May 18 01:39:43.172918 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 113/215] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:43 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 247 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:43.179714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:43.180904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:43.190765 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.191508 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.192650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.193183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.351285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5d4b775c-7651-4cc4-998e-788ce9a99c84 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 23220 microversion: 2.1 time: 0.178352 May 18 01:39:43.352152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 114/216] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:43 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 23220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:43.359558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:43.363719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:43.383926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.387338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.388703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:43.391883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:43.403817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:43.415032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7265c81b-184b-4c8f-9ff8-5447e4d79181 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.734985 May 18 01:39:43.416955 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 103/217] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:42 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:43.914492 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:43.925806 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-86b9cdf9-f7d8-4cfd-858c-4719525004ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.570947 May 18 01:39:43.926392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 115/218] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:43 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:44.048206 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:44.048867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:44.060972 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.067340 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.068644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.069573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.185095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:44.186382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:44.195089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.195689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.197007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.197594 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.328903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a72e1449-35c3-4ec6-b42c-578ce18d46c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 9709 microversion: 2.20 time: 0.151678 May 18 01:39:44.333526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 116/219] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:44 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 9709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:39:44.341351 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-41536819-de86-4d37-97c2-758be91e6200 req-de74362b-2ef3-4453-ae4a-f9fe9069f11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62020e0b-e4eb-4768-bd36-06357c7c3817", "tag": "fcacad8c-00a8-4188-8908-a78179aa3614"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:44.343477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:44.343477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:44.357798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-41536819-de86-4d37-97c2-758be91e6200 req-de74362b-2ef3-4453-ae4a-f9fe9069f11f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.358819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-41536819-de86-4d37-97c2-758be91e6200 req-de74362b-2ef3-4453-ae4a-f9fe9069f11f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.380754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-41536819-de86-4d37-97c2-758be91e6200 req-de74362b-2ef3-4453-ae4a-f9fe9069f11f service nova] Creating event network-changed:fcacad8c-00a8-4188-8908-a78179aa3614 for instance 62020e0b-e4eb-4768-bd36-06357c7c3817 on hv-cinder-78462 May 18 01:39:44.393793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-41536819-de86-4d37-97c2-758be91e6200 req-de74362b-2ef3-4453-ae4a-f9fe9069f11f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058459 May 18 01:39:44.395450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 117/220] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:44.402245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:44.403909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:44.415023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.415901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.417499 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.419450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.555490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-eaff829e-b813-4344-940d-1c1a6952295d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 24491 microversion: 2.1 time: 0.158310 May 18 01:39:44.556160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 118/221] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:44 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 24491 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:44.565987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:44.566934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:44.573869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:44.586056 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0827daaf-5a86-4749-882c-30134d994535 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.539715 May 18 01:39:44.586670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 104/222] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:44 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:44.600543 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.601005 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.601798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.602240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.942833 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:44.943459 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:44.955581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.956061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:44.956888 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:44.957334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.066130 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:45.077783 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-57a40704-0a11-40d6-9bdc-ad4baef1d223 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.516191 May 18 01:39:45.079953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 119/223] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:44 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:45.336728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:45.341402 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:45.342334 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:45.352514 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-16eb6473-d254-437c-abe2-ba092e0cf130 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.413045 May 18 01:39:45.353933 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 105/224] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:44 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:45.364145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.366457 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.367519 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.367973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.530848 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-64df7da5-ee8a-44ce-b6fc-5a6de65b70f6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 15025 microversion: 2.20 time: 0.193981 May 18 01:39:45.531517 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 120/225] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:45 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 15025 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:45.567536 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:45.568750 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:45.579766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.580461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.581054 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.581503 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.603844 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:45.604455 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:45.634966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.635470 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.636881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:45.637318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:45.804663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b4d03ab1-ebb1-4235-9f1e-71fff59b470a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 25597 microversion: 2.1 time: 0.240708 May 18 01:39:45.805802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 106/226] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:45 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 25597 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:46.095060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:46.095939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:46.109986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.110449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.111279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.115074 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.252928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:46.272501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-23eab8fb-6898-4689-bb40-c4dcc887328e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.672838 May 18 01:39:46.273268 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 121/227] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:45 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:46.369899 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:46.370510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:46.378958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.379862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.381015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.381474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.608544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:46.625809 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8df17b05-adbd-4b03-9e05-fea4577b87f2 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.533994 May 18 01:39:46.627978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 107/228] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:46 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:46.641355 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:46.642562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:46.650624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.651234 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.653131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.653677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.719891 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:46.729215 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-626cc55d-3590-4a19-a863-b372fef9b9ca tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1522 microversion: 2.1 time: 0.363142 May 18 01:39:46.732637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 122/229] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:46 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:46.759998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1c2f1b24-2772-4d72-b190-4d19f0fb421f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 17861 microversion: 2.20 time: 0.130146 May 18 01:39:46.760686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 108/230] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:46 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 17861 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:46.816763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:46.817955 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:46.825707 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.826428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.828024 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:46.828708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:46.952157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-107cfde8-fcaf-4a9c-a9e6-7e935c48ed56 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 26094 microversion: 2.1 time: 0.139662 May 18 01:39:46.952941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 123/231] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:46 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 26094 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:47.290923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:47.291665 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:47.301172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.301631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:47.302422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.302865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:47.524796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:47.534140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b9eefb6c-1dd2-44f1-b159-e59a10fc58ed tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.247335 May 18 01:39:47.534738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 109/232] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:47 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:47.648135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:47.649498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:47.660830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.661371 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:47.662224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.662723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:47.751610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:47.752248 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:47.763036 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.763551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:47.764440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:47.764866 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.009955 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:48.018710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4ce6f7aa-5ecd-4ae2-8aa1-649d4fbac99c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.379179 May 18 01:39:48.019808 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 124/233] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:47 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:48.030134 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:48.031053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:48.040853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.040853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.040853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.040853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.116111 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:48.124720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fbda59da-8972-4cb6-8c02-edb1c173a369 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1502 microversion: 2.1 time: 0.381645 May 18 01:39:48.125296 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 110/234] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:47 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:48.129721 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:48.130790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:48.138702 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.139159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.139946 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.140413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.158517 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-218fa0b6-35cf-46aa-9d7d-a38a1842441a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 18013 microversion: 2.20 time: 0.137203 May 18 01:39:48.159629 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 125/235] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:48 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 18013 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:48.165422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:48.166434 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:48.177112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.177815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.178870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.179744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.254618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f8a6c2dc-6e9a-4fde-a40c-63ba9609a4e4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 26846 microversion: 2.1 time: 0.128035 May 18 01:39:48.255260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 111/236] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:48 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 26846 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:48.551595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:48.552313 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:48.560375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.560998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.561788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:48.562341 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:48.654941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:48.663460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a2a87374-283f-46d9-bcd7-dc3f5b40d527 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1515 microversion: 2.1 time: 0.502386 May 18 01:39:48.664127 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 126/237] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:48 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:48.810315 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:48.819344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4029193d-4892-4ec3-a5e8-752bf2d67a41 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.272223 May 18 01:39:48.820054 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 112/238] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:48 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:49.045716 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:49.046728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:49.062355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.063271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:49.064232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.064905 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:49.171025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:49.171965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:49.179195 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.179658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:49.180489 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.180923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:49.282745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:49.291197 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-09a79b45-1c6d-4659-84f5-32c6515224cb tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.260190 May 18 01:39:49.291934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 127/239] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:49 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:49.303928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:49.304940 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:49.312450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.312917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:49.313702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:49.314167 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:51.716548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b43dd2ce-19d4-4f16-820d-29fc87ca0b0c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 27742 microversion: 2.1 time: 2.423086 May 18 01:39:51.718092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 128/240] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:49 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 27742 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:51.719508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5edaadb7-abec-40f3-b1ac-7da085443f72 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 24140 microversion: 2.20 time: 2.552134 May 18 01:39:51.720186 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 113/241] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:49 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 24140 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:39:51.724255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:51.725230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:51.725659 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:51.726383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:51.735357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:51.735618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:51.735816 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:51.736238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:51.736627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:51.737061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:51.737159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:51.737535 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.177013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:52.181183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:52.186796 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ba8049e6-7aa5-4da8-b7b7-efff17e48781 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.467222 May 18 01:39:52.187409 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 129/242] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:51 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:52.192085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-d919400c-154a-4846-bcc6-3e5b0190245f req-8bb9175a-4959-441c-8e67-4ff9b4cd9fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28643b97-a331-4302-b5f5-9fe7c405176e", "name": "network-vif-plugged", "status": "completed", "tag": "29f9517c-823f-4646-ba1a-55881c81a4f6"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:52.193900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:52.193900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:52.201587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-896d61bb-f2fd-4dea-84cd-9ec3ee438b64 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.480187 May 18 01:39:52.202284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 114/243] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:51 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:52.203738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d919400c-154a-4846-bcc6-3e5b0190245f req-8bb9175a-4959-441c-8e67-4ff9b4cd9fc7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.204193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d919400c-154a-4846-bcc6-3e5b0190245f req-8bb9175a-4959-441c-8e67-4ff9b4cd9fc7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.220856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-d919400c-154a-4846-bcc6-3e5b0190245f req-8bb9175a-4959-441c-8e67-4ff9b4cd9fc7 service nova] Creating event network-vif-plugged:29f9517c-823f-4646-ba1a-55881c81a4f6 for instance 28643b97-a331-4302-b5f5-9fe7c405176e on hv-cinder-78462 May 18 01:39:52.225834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-d919400c-154a-4846-bcc6-3e5b0190245f req-8bb9175a-4959-441c-8e67-4ff9b4cd9fc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037280 May 18 01:39:52.226478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 130/244] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:52.412845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:52.413858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:52.421814 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.422273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.423060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.423500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.480947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lazy-loading 'flavor' on Instance uuid dca767d8-1b78-4c0e-a024-8c965bbc81fb {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:39:52.626021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9abb24a8-5f2d-47cf-ace2-0716afb54682 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action" status: 200 len: 32 microversion: 2.1 time: 0.216927 May 18 01:39:52.626638 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 115/245] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:52 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:39:52.636714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:52.637567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:52.645930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.646680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.647696 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.648170 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.731679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:52.733352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:52.742770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.743535 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.744599 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.746486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.882603 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9b52199b-ce30-475e-88f2-385f4a5b61cd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 25034 microversion: 2.20 time: 0.155010 May 18 01:39:52.883932 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 116/246] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:52 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 25034 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:39:52.891621 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:52.892719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:52.901076 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.902195 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:52.903587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:52.904026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.038220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b37fd4ad-2861-4f1c-a97e-b196b1a7aeda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.153441 May 18 01:39:53.039160 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 117/247] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:52 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:53.053560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:53.062338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-46e7496b-ac73-443f-a5a8-a8889a9f0fb9 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.430271 May 18 01:39:53.062912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 131/248] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:52 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:53.205278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:53.205993 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:53.213852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.214444 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.215216 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.215658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.220886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:53.221702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:53.230737 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.231168 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.232110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.232637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.514241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:53.521897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:53.522586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ccdb3795-89e9-4aaa-b586-10c22f52bdfe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.321271 May 18 01:39:53.523163 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 118/249] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:53 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:53.536989 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-43cb62df-43ad-420f-8546-5f3df95895f3 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.319835 May 18 01:39:53.537565 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 132/250] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:53 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:53.894902 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:53.895862 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:53.904544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.905005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:53.905804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:53.906250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:54.049836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:54.050769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:54.058948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:54.059506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:54.060186 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:54.060819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.262033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a7708cc7-c391-419a-ab90-9e800668d087 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 27362 microversion: 2.20 time: 2.370081 May 18 01:39:56.263502 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 119/251] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:53 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 27362 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:56.265750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-42293431-386e-4af0-ac5c-fc150f4cc2a0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 2.219286 May 18 01:39:56.266914 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 133/252] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:54 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:56.272356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-e527233c-a8ba-4f59-9dc9-11a45cbea71f req-7f137e9c-9728-49e5-8c4e-fb05622bc90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62020e0b-e4eb-4768-bd36-06357c7c3817", "name": "network-vif-plugged", "status": "completed", "tag": "fcacad8c-00a8-4188-8908-a78179aa3614"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:56.278562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:56.278562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:56.278758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:39:56.278758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:39:56.285761 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.286212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.287185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.287631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.298706 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-e527233c-a8ba-4f59-9dc9-11a45cbea71f req-7f137e9c-9728-49e5-8c4e-fb05622bc90a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.299235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-e527233c-a8ba-4f59-9dc9-11a45cbea71f req-7f137e9c-9728-49e5-8c4e-fb05622bc90a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.317167 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-e527233c-a8ba-4f59-9dc9-11a45cbea71f req-7f137e9c-9728-49e5-8c4e-fb05622bc90a service nova] Creating event network-vif-plugged:fcacad8c-00a8-4188-8908-a78179aa3614 for instance 62020e0b-e4eb-4768-bd36-06357c7c3817 on hv-cinder-78462 May 18 01:39:56.322014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-e527233c-a8ba-4f59-9dc9-11a45cbea71f req-7f137e9c-9728-49e5-8c4e-fb05622bc90a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053885 May 18 01:39:56.322821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 134/253] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:39:56.329687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:56.330015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:56.338057 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.338509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.339554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.340152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.827973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:56.836319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f1630bf9-3f81-45c2-883a-66904c9a39b8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.511558 May 18 01:39:56.837542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 135/254] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:56 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:56.843236 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:56.844013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:56.845580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:56.851924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.852620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.853630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:56.854247 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:56.854878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-57bc561c-b4a5-4a62-b9a4-f5dd7ce5dfa7 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.589067 May 18 01:39:56.856068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 120/255] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:56 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:57.123577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:57.133479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-491f8515-e619-460c-bacf-e729400b1776 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1313 microversion: 2.1 time: 0.294784 May 18 01:39:57.134578 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 136/256] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:56 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:57.275218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:57.277157 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:57.278171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:57.279159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:57.286507 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.287063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.287508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.287623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.288506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.288958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.289064 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.289741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.430392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3e362d10-dd26-4d31-b2f1-da8472abd93c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.156446 May 18 01:39:57.432341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 137/257] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:57 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:39:57.453487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-31d5b9bf-4ee4-4e7f-8e33-a9c11244740e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 27506 microversion: 2.20 time: 0.181930 May 18 01:39:57.454125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 121/258] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:57 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 27506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:39:57.856359 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:57.857225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:57.866344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.866809 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.867772 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.868206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.874677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:57.889199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:57.903318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.903795 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:57.904591 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:57.905027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.264543 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:58.269577 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:58.279293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-63d8d794-6b97-4dc5-a033-4d26b5ce79e5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.409848 May 18 01:39:58.280471 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 122/259] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:57 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:39:58.286164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:58.287022 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:58.295575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.296082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.297048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.297684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.318020 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c3d371c8-bf69-4044-9820-1e595b8136e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1318 microversion: 2.1 time: 0.466992 May 18 01:39:58.321095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 138/260] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:57 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:58.442576 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:58.444079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:58.452667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.453475 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.454393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.455439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.543853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:58.555174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f3220a46-08e2-4221-8102-87078dbf84f9 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1498 microversion: 2.1 time: 0.273259 May 18 01:39:58.556129 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 123/261] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:58 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1498 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:58.561421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:58.562697 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:58.592795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-dee1bb1e-09bd-4a35-ad9a-54e2e9ebedaa tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.153679 May 18 01:39:58.593260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.593729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.594313 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 139/262] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:58 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:39:58.594540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:58.594991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:58.762095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dcd54217-df6b-4e9a-a7e4-742e0b301ee3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 27697 microversion: 2.20 time: 0.203579 May 18 01:39:58.764518 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 124/263] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:58 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 27697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:39:59.300787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:59.301753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:59.311121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.311844 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.312948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.314159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.339293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:59.340034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:59.348783 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.349549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.350480 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.351126 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.703279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:59.707832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:39:59.716737 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f9687416-a7fd-4cbb-a32b-3fe833a028ae tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.421799 May 18 01:39:59.717556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d75dbb2b-ea1c-4c18-b0dd-1df173c92bb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1508 microversion: 2.1 time: 0.382661 May 18 01:39:59.718595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 125/264] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:59 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:59.723137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:59.724071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:59.725806 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 140/265] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:39:59 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:39:59.738917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.739386 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.740179 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.740656 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.760584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:39:59.762244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:59.772148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.772924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.775502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.776195 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.852466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:39:59.866452 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1e125f30-0089-4bfa-91f7-ca931f2b938c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.146213 May 18 01:39:59.867112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 126/266] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:39:59 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:39:59.873900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:39:59.877824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:39:59.895987 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.897970 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:39:59.898961 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:39:59.899469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.021561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-71a0538b-ba31-49ef-867a-459ddb0f042e tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 204 len: 0 microversion: 2.1 time: 0.265205 May 18 01:40:00.022859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 141/267] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:39:59 2021] DELETE /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:40:00.034308 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:00.035590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:00.044617 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.045618 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.046435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.046882 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.110333 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-01fd2ab6-6fca-4a49-84ce-727debd5e03b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28062 microversion: 2.20 time: 0.241445 May 18 01:40:00.111432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 127/268] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:39:59 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28062 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:00.342909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:00.352457 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3b05db92-5731-4f2a-b464-3b029c206a24 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1504 microversion: 2.1 time: 0.324579 May 18 01:40:00.356174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 142/269] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:00 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:00.747801 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:00.748555 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:00.766305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.766772 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.767879 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.768371 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.878276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:00.879404 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:00.889381 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.890183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.891390 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:00.892875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:00.998578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:01.007299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-97ee468e-b5a7-4ed5-a8f8-7e1e91f6cb1f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.266069 May 18 01:40:01.007962 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 128/270] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:00 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:01.066034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c53f354a-c490-4406-a46a-602fb086d342 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.191384 May 18 01:40:01.066870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 143/271] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:00 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:01.123913 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:01.126241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:01.135470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.136285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:01.137259 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.137704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:01.376267 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:01.377015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:01.384904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.385366 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:01.386658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.387104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:01.591484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:01.600426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-63db63cc-821a-4de5-840c-bdd11c6ab337 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1504 microversion: 2.1 time: 0.231112 May 18 01:40:01.600918 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 144/272] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:01 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:01.610791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453e1bbc-fca4-4c96-a35c-4e4dd5e389cf"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:01.610791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:01.614639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.615094 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:01.615872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:01.616331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.441210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1f32d66d-fec6-4b6c-a849-73d236e0628e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28177 microversion: 2.20 time: 3.321378 May 18 01:40:04.442045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 129/273] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:01 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28177 bytes in 3323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:04.451357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:04.452607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:04.461840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.462291 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.463282 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.464783 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.624349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-19d7d011-e0ef-4eb1-a475-95a80890b9c2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.022038 May 18 01:40:04.624941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 145/274] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:01 2021] POST /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments => generated 194 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:04.642642 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:04.644663 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:04.656097 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.656706 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.657787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.658239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.702661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:04.710756 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-502a01ca-3ccb-4920-ba1f-5b8620180610 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.267716 May 18 01:40:04.711587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 130/275] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:04 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:04.725243 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:04.726029 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:04.733939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.734532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.735443 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:04.735886 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:04.788331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-92275bad-2d6c-407f-bf1a-1cdd18631064 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.161587 May 18 01:40:04.792437 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 146/276] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:04 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:04.957644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:04.967324 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fea0379a-240a-41d0-9a4b-d57a0ad5cc72 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1504 microversion: 2.1 time: 0.254360 May 18 01:40:04.968216 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 131/277] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:04 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:05.455083 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:05.456106 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:05.465331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.465793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.466728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.467176 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.624125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4849ff1c-5cb5-4032-9efc-9143be7e9722 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28177 microversion: 2.20 time: 0.173198 May 18 01:40:05.625023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 147/278] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:05 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28177 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:05.729023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:05.729773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:05.738906 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.739741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.740793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.741442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.812157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:05.813330 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:05.822833 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.823526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.824462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:05.825001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:05.949958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cbb267e7-aadc-4cd5-bd02-d6bc6f78b0e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28167 microversion: 2.1 time: 0.151508 May 18 01:40:05.950502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 148/279] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:05 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28167 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:05.988042 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:05.989405 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:06.000941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.000941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.002700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.002822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.238767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:06.248571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7e2ae1ac-4f13-46a9-bb77-8455203f9df2 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.523167 May 18 01:40:06.258548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 132/280] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:05 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:06.490397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:06.501721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-16e7af00-570b-4d37-8229-ca8e9a1ca909 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1504 microversion: 2.1 time: 0.519448 May 18 01:40:06.502939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 149/281] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:05 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:06.636021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:06.637466 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:06.658005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.658739 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.659726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.660345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.774149 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-80737072-3701-4176-8fb5-7726cadd9c5c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28177 microversion: 2.20 time: 0.142506 May 18 01:40:06.774803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 133/282] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:06 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28177 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:06.794127 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-982fa49c-a2b5-418a-bc86-c34bb7861c6a req-579de92c-6bdd-42ce-8097-630a289c12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28643b97-a331-4302-b5f5-9fe7c405176e", "name": "network-vif-deleted", "tag": "29f9517c-823f-4646-ba1a-55881c81a4f6"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:06.796653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:06.796653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:40:06.807277 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-982fa49c-a2b5-418a-bc86-c34bb7861c6a req-579de92c-6bdd-42ce-8097-630a289c12a7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.807550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-982fa49c-a2b5-418a-bc86-c34bb7861c6a req-579de92c-6bdd-42ce-8097-630a289c12a7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.832503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-982fa49c-a2b5-418a-bc86-c34bb7861c6a req-579de92c-6bdd-42ce-8097-630a289c12a7 service nova] Creating event network-vif-deleted:29f9517c-823f-4646-ba1a-55881c81a4f6 for instance 28643b97-a331-4302-b5f5-9fe7c405176e on hv-cinder-78462 May 18 01:40:06.840155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-982fa49c-a2b5-418a-bc86-c34bb7861c6a req-579de92c-6bdd-42ce-8097-630a289c12a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049139 May 18 01:40:06.841082 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 150/283] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:40:06.962960 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:06.964909 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:06.973417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.978156 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:06.979869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:06.980560 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.105876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-098e3a48-d767-4135-b1e1-93d10a6e5f2d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28458 microversion: 2.1 time: 0.147353 May 18 01:40:07.107511 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 134/284] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:06 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:07.267137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:07.268053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:07.278529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.278973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.279763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.280230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.529332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:07.530509 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:07.539423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.540271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.541452 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.542513 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.614560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:07.629528 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5fb565a5-876d-4cd5-8fa3-1ab796b09206 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.367195 May 18 01:40:07.632416 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 151/285] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:07 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:07.640586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.640586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.640586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lazy-loading 'fault' on Instance uuid 28643b97-a331-4302-b5f5-9fe7c405176e {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:40:07.741930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7865a316b442797dbbdedf27297de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6f3859cf8e4b078185ad84e62d51a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:07.752384 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fc4a2fc9-b72c-48e0-86d1-b9f90fcae53c tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 200 len: 1303 microversion: 2.1 time: 0.236794 May 18 01:40:07.764096 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 135/286] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:07 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:07.787614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:07.788746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:07.798342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.799460 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.800482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:07.801272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:07.951256 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a7299a28-165e-480b-893e-9f5ffec3eb48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28177 microversion: 2.20 time: 0.167619 May 18 01:40:07.952968 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 152/287] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:07 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28177 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:08.117414 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:08.118350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:08.128314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.128314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.128314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.128601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.248603 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-21a3e062-09a0-4aa4-be32-41ce7d4a858b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28458 microversion: 2.1 time: 0.134757 May 18 01:40:08.249422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 136/288] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:08 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28458 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:08.650187 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:08.650916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:08.659612 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.660074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.660898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.661346 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.771303 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:08.772123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] [instance: 28643b97-a331-4302-b5f5-9fe7c405176e] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:08.780398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.781052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.781976 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.782418 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.834410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] HTTP exception thrown: Instance 28643b97-a331-4302-b5f5-9fe7c405176e could not be found. May 18 01:40:08.835027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] Returning 404 to user: Instance 28643b97-a331-4302-b5f5-9fe7c405176e could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:40:08.835876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fc2216fe-c618-484f-b12c-bd6eebe3b5f4 tempest-VolumesActionsTest-163531855 tempest-VolumesActionsTest-163531855-project] 10.222.0.16 "GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e" status: 404 len: 111 microversion: 2.1 time: 0.069000 May 18 01:40:08.836736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 137/289] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:08 2021] GET /compute/v2.1/servers/28643b97-a331-4302-b5f5-9fe7c405176e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 01:40:08.887701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:08.895922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-84e34b80-d7a7-4401-805b-28177e02f092 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.250178 May 18 01:40:08.896525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 153/290] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:08 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:08.966273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:08.967217 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:08.983325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.984981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:08.987413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:08.988159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:09.153343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-da831267-1cfc-4280-807e-f240f1a25e98 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28177 microversion: 2.20 time: 0.191851 May 18 01:40:09.156624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 138/291] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:08 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28177 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:09.261784 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:09.262723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:09.270477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:09.270941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:09.271737 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:09.272185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:09.400516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5a7c4147-6755-4e9a-8a58-edcc1ea5ab8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.143781 May 18 01:40:09.401096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 154/292] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:09 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:09.913364 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:09.914079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:09.922816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:09.923316 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:09.924169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:09.924739 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.124579 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:10.133882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-40c181a1-3bb6-4e78-bc90-86acbe806ad8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.224463 May 18 01:40:10.134600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 139/293] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:09 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:10.165768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:10.167158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:10.175134 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.175596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.176485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.176924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.296996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-47f0df4d-0be0-45d5-920d-7a3f46edef49 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28430 microversion: 2.20 time: 0.134929 May 18 01:40:10.299311 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 155/294] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:10 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28430 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:10.337406 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-961719992", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:10.404520 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] validate_networks() for None {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:40:10.413652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:10.414859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:10.423483 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.423939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.424772 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.425239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.541218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7eb60ad2-3eb1-474e-bced-ad2658236922 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.131412 May 18 01:40:10.544424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 156/295] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:10 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:10.671349 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:40:10.671780 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:40:10.672257 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:40:10.672696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:40:10.673120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:40:10.681654 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.682153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.683566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:10.684010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:10.702110 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Getting quotas for project 9d7700d14079481982fb6ae9a18c6224. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:40:10.706052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Getting quotas for user a3c53a1f58c3437c96515e44d7fdc79e and project 9d7700d14079481982fb6ae9a18c6224. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:40:10.718322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:40:10.720657 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:40:10.769772 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2c160992-1b84-4bbd-a8e5-862b03de2703 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436186 May 18 01:40:10.770896 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 140/296] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:40:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:40:10.781734 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-acd93e04-d33a-47d8-8155-1d7316d3932a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:10.782442 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-acd93e04-d33a-47d8-8155-1d7316d3932a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:10.856087 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-acd93e04-d33a-47d8-8155-1d7316d3932a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:10.863651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-acd93e04-d33a-47d8-8155-1d7316d3932a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1214 microversion: 2.1 time: 0.086275 May 18 01:40:10.864230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 157/297] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:10 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:11.152990 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:11.153766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:11.163304 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.163900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:11.164792 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.165310 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:11.309120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:11.310059 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:11.322322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.327841 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:11.328872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.329320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:11.390379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:11.398973 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8c77ea56-a04a-4725-a6b9-2655e6718250 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.251125 May 18 01:40:11.399547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 141/298] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:11 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:11.556472 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:11.557734 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:11.565295 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.565746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:11.566531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:11.566966 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:14.000013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-20db4041-d843-47ad-a073-47bc35a9af9e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28467 microversion: 2.20 time: 2.695130 May 18 01:40:14.000713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 158/299] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:11 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28467 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:14.004655 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d911fedb-9693-4702-a849-d5c40321bdd1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 2.453014 May 18 01:40:14.005376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 142/300] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:11 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:14.007459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:14.008246 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:14.012255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:14.013308 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:14.016470 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:14.016939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:14.017730 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:14.018308 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:14.021537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:14.022174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:14.023142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:14.023593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:14.188757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:14.198105 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2d49be37-8193-44b2-af92-7d8ab45a217c tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1218 microversion: 2.1 time: 0.195534 May 18 01:40:14.198848 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 159/301] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:14 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:14.282449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:14.290661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-40f184f0-728f-47e4-a08e-30bd8fa02258 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.283806 May 18 01:40:14.291300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 143/302] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:14 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:15.012820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:15.014601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:15.018715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:15.020584 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:15.026339 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.027099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.028368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.029334 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.037540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.038398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.040038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.041781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.255299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2f92ac0c-79dd-4887-a889-601a503f364f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.242085 May 18 01:40:15.261256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 144/303] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:15 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:15.262099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bd15eaf0-e861-48e4-8cf2-a6bd95ed92d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28467 microversion: 2.20 time: 0.253706 May 18 01:40:15.263509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 160/304] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:15 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:15.267238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:15.268114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:15.277957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.278417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.279394 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.279999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.312372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:15.313510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:15.325803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.326264 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.327126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.327602 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.472142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:15.483092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c6b3c439-ad70-4e30-b99e-8df11869a202 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1272 microversion: 2.1 time: 0.220056 May 18 01:40:15.483959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 145/305] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:15 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:15.676214 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:15.687157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-73d18c2f-6907-4567-93cc-2ad041a7e7bb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.381582 May 18 01:40:15.698122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 161/306] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:15 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:15.939486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453e1bbc-fca4-4c96-a35c-4e4dd5e389cf"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:15.941345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:15.958023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.959061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:15.960133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:15.961420 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.231020 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Invalid volume: volume 453e1bbc-fca4-4c96-a35c-4e4dd5e389cf is already attached to instances: 62020e0b-e4eb-4768-bd36-06357c7c3817 May 18 01:40:16.231823 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 400 to user: Invalid volume: volume 453e1bbc-fca4-4c96-a35c-4e4dd5e389cf is already attached to instances: 62020e0b-e4eb-4768-bd36-06357c7c3817 {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:40:16.232921 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e66c75db-2564-4f8e-9698-0585954d0f88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.298419 May 18 01:40:16.233554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 146/307] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:15 2021] POST /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments => generated 174 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 01:40:16.278572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:16.279658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:16.280663 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:16.282024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:16.316292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.317415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.318074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.322263 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.325522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.326058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.333066 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.334172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.462202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5760c372-0c71-4b89-9b9f-aab397237ea9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.198012 May 18 01:40:16.463153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 162/308] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:16 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:16.469294 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:16.469947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:16.478230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.479322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.480649 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.481112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.527554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c44b3d83-f305-441b-b07b-0f62d9706689 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.256573 May 18 01:40:16.531871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 147/309] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:16 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:16.536840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:16.539607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:16.569637 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.570490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.571789 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.572374 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.693956 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lazy-loading 'services' on Instance uuid 62020e0b-e4eb-4768-bd36-06357c7c3817 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:40:16.941333 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-988a8c3d-0dd4-423e-a86d-cbb58d0b9efc tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments/453e1bbc-fca4-4c96-a35c-4e4dd5e389cf" status: 202 len: 0 microversion: 2.1 time: 0.475365 May 18 01:40:16.942234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 163/310] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:40:16 2021] DELETE /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817/os-volume_attachments/453e1bbc-fca4-4c96-a35c-4e4dd5e389cf => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:16.966048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:16.968973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:16.993301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.996070 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:16.998252 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:16.998761 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:17.335009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:17.351737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-31b36c87-73e6-4395-8a34-1ac1c902e67e tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.821066 May 18 01:40:17.352610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 148/311] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:16 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:17.477734 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:17.479153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:17.497858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:17.498531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:17.499488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:17.500083 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:17.629516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:17.657466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7ecd46a1-0082-4af0-bacb-27e2a5cc15f1 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.713585 May 18 01:40:17.659465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-513b81ae-6e3f-4f4d-9cd6-da714285088c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.188398 May 18 01:40:17.669770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 149/312] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:17 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:17.677286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:17.680478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 164/313] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:16 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:17.686765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:17.696877 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:17.697417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:17.699689 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:17.699689 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:17.887212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-09b80aeb-a6f6-413d-85b6-131aa3c5ec87 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.215431 May 18 01:40:17.887749 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 150/314] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:17 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:18.381256 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:18.381905 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:18.393410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:18.394299 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:18.395943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:18.396611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:18.530010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-112074179", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "34ad0de6-e603-440b-8c73-37173bf6aad9"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:18.854913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:18.879335 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fe7f5187-d617-4da6-8774-cfe2aa77d24b tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.504825 May 18 01:40:18.884431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 165/315] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:18 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:18.922373 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-07ab190b-7d23-438d-8e7d-13ca5d505e6b req-7a5abfa2-80ab-413b-a068-a921b7a7ff80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014efcc0-20a4-4ce5-b190-6c53a3098130", "tag": "4471f092-4c32-4127-841f-194070f04887"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:18.928979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:18.928979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:40:18.952415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-07ab190b-7d23-438d-8e7d-13ca5d505e6b req-7a5abfa2-80ab-413b-a068-a921b7a7ff80 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:18.953136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-07ab190b-7d23-438d-8e7d-13ca5d505e6b req-7a5abfa2-80ab-413b-a068-a921b7a7ff80 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:18.982593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-07ab190b-7d23-438d-8e7d-13ca5d505e6b req-7a5abfa2-80ab-413b-a068-a921b7a7ff80 service nova] Creating event network-changed:4471f092-4c32-4127-841f-194070f04887 for instance 014efcc0-20a4-4ce5-b190-6c53a3098130 on hv-cinder-78462 May 18 01:40:18.988656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-07ab190b-7d23-438d-8e7d-13ca5d505e6b req-7a5abfa2-80ab-413b-a068-a921b7a7ff80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105869 May 18 01:40:18.990112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 166/316] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:18.996325 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:18.997904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:19.018911 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.019595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.020597 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.022626 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.160193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-af3abb37-a6f3-45d4-bfdd-4b0fb8a7c7c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28625 microversion: 2.1 time: 0.167647 May 18 01:40:19.161120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 167/317] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:18 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28625 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:19.170350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:19.171526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:19.183058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.183902 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.186030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.187043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.566892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:19.575949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ba6f6c18-4d49-4d8a-a68f-301f0da64f7d tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1501 microversion: 2.1 time: 0.412903 May 18 01:40:19.576750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 168/318] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:19 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1501 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:19.599104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:19.600045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:19.608625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.609352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.610320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.610768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.718501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d1609fa5-9c4b-489e-8728-c7d556260900 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.124504 May 18 01:40:19.719814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 169/319] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:19 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:19.724266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82097a74-c146-4a53-9b8b-be0c2564cb95"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:19.725456 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:19.733974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.734444 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.735245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.735719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.809410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] HTTP exception thrown: Cannot 'attach_volume' instance dca767d8-1b78-4c0e-a024-8c965bbc81fb while it is in vm_state rescued May 18 01:40:19.810549 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Returning 409 to user: Cannot 'attach_volume' instance dca767d8-1b78-4c0e-a024-8c965bbc81fb while it is in vm_state rescued {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:40:19.811424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-99863890-6781-45f7-bb60-c117b70d6414 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091247 May 18 01:40:19.811988 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 170/320] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:19 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 01:40:19.820159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:19.820737 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:19.831172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.831985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:19.832927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:19.833719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:20.083810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0f0e6c56-aaf2-4a61-9827-1d9eca6fb6fc tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action" status: 202 len: 0 microversion: 2.1 time: 0.266761 May 18 01:40:20.086178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 171/321] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:19 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:20.103218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:20.104724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:20.112937 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:20.113401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:20.114237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:20.114683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:20.532350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:20.542778 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-aad2ae0e-3be3-411c-a765-2ad4d496b406 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.454994 May 18 01:40:20.543782 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 172/322] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:20 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:20.560930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:20.561482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:20.588664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:20.589136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:20.589970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:20.590422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:20.990625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:21.007745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-768bfb1f-5441-439f-af1f-e7f9e79a78b5 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1509 microversion: 2.1 time: 0.452068 May 18 01:40:21.017507 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 173/323] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:20 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:21.021985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:21.022962 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:21.031452 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.032388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.032897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.033506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.167932 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5c0d693c-e23a-48ec-acf1-a5224bfb3c50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 28957 microversion: 2.1 time: 0.149213 May 18 01:40:21.168699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 174/324] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:21 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 28957 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:21.174764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:21.175946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:21.185185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.185642 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.186575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.187033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.319374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-502e650b-e1d6-46ce-9099-868e6efe54d7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.149343 May 18 01:40:21.320068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 175/325] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:21 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:21.559750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:21.560786 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:21.570244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.570790 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.571692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:21.573005 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:21.787419 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:21.796530 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d311d4fe-8014-4057-8b50-ed0ee77b1cc0 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.241242 May 18 01:40:21.797131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 176/326] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:21 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:22.023023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:22.023561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:22.031948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.032469 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.033483 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.034145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.319432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:22.329945 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-34c6e358-3b55-4f60-8e52-472a4dfa2c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1509 microversion: 2.1 time: 0.310731 May 18 01:40:22.330740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 177/327] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:22 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:22.335933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:22.337155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:22.345855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.346319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.347302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.347758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.633861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-83ef2990-3c73-47d1-9983-7ed42cfa2cd2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 30051 microversion: 2.1 time: 0.301801 May 18 01:40:22.634662 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 178/328] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:22 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 30051 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:22.640541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:22.641594 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:22.656646 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.657115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.658045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.658927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.778173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-080b1041-b158-4389-8ef6-29b26e630819 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.141753 May 18 01:40:22.779321 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 179/329] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:22 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:22.814596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:22.815467 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:22.825775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.826240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:22.827285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:22.827733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.057644 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:23.065967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-023f7c91-9ab6-474f-9e46-1352ddea11da tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.256165 May 18 01:40:23.066712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 180/330] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:22 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:23.348586 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:23.349977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:23.357787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.358369 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.359167 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.359604 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.595829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:23.608789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c02c138f-4bff-4d29-878f-3b7674d81946 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1509 microversion: 2.1 time: 0.263689 May 18 01:40:23.609599 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 181/331] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:23 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:23.646676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:23.647692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:23.656462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.656924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.657740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.658194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.783522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c1a93181-7997-423b-9f3f-f41f09f12d9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 31010 microversion: 2.1 time: 0.140247 May 18 01:40:23.789181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 182/332] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:23 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 31010 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:23.796179 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] validate_networks() for [('34ad0de6-e603-440b-8c73-37173bf6aad9', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:40:23.801044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:23.802243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:23.811511 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.812053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.812942 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:23.813447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:23.930558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5392bf10-a486-4d6d-a0be-4a055d60cd05 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28737 microversion: 2.20 time: 0.139654 May 18 01:40:23.932579 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 183/333] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:23 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28737 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:24.084975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:24.086062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:24.096039 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.096875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.097920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.098368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.490923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:24.501982 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bf7d1a4c-b525-4ece-ac0b-af7140378263 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.422444 May 18 01:40:24.502920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 184/334] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:24 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:24.519593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:40:24.520040 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:40:24.524937 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:40:24.526234 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:40:24.526709 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:40:24.539332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.539790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.540678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.541184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.563078 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:40:24.567587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Getting quotas for user 51d547b6ec5747ac8cf1a52579144454 and project 7818818dab5a4878b403e46b3fedf215. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:40:24.580057 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:40:24.582624 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:40:24.629131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:24.629768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:24.641077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.641527 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.642345 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.644952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2825d559-78dd-450b-bf51-59d41087e1ad tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.120212 May 18 01:40:24.651129 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.652649 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 151/335] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:40:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 6129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:40:24.658533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3591446e-fcdb-4614-b41d-dd8b65edb9ab tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:24.659152 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3591446e-fcdb-4614-b41d-dd8b65edb9ab tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:24.748975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3591446e-fcdb-4614-b41d-dd8b65edb9ab tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:24.761541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3591446e-fcdb-4614-b41d-dd8b65edb9ab tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1217 microversion: 2.1 time: 0.107690 May 18 01:40:24.771643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 152/336] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:24 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:24.796933 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:24.798123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:24.833784 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.834463 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:24.841092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:24.841614 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.023817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dea39c90-5fcb-4c86-8ad0-21f221cb7a93 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 31978 microversion: 2.1 time: 0.229741 May 18 01:40:25.031031 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 153/337] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:24 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 31978 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:25.039444 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:25.047895 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:25.073357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.075181 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.076254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.077574 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.093715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:25.113509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4a10d276-c0fa-4f49-9fd3-9489bbdc214c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1515 microversion: 2.1 time: 0.486813 May 18 01:40:25.117700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 185/338] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:24 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1515 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:25.250007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c3d6dc42-3869-486e-9d24-c65b4b05de48 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 28850 microversion: 2.20 time: 0.217275 May 18 01:40:25.250893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 154/339] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:25 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 28850 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:25.525261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:25.526885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:25.551138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.552349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.553815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.555037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.780358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:25.781394 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:25.789771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.790268 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.791811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:25.792269 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:25.834599 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:25.845701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e31aaa3f-89d4-40ba-bc7f-f496e38497c8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.327267 May 18 01:40:25.846529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 186/340] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:25 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:25.945947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:25.956925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6dab5a1c-9782-4f93-9dbb-6002b5455dd3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1269 microversion: 2.1 time: 0.181632 May 18 01:40:25.967408 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 155/341] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:25 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:26.042044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:26.043302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:26.058059 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.058542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.059546 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.060017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.186631 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-54a6ea5c-c96d-4386-a188-d39f3e307cca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 32510 microversion: 2.1 time: 0.150385 May 18 01:40:26.187735 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 187/342] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:26 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 32510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:26.272554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:26.276692 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:26.309365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.310273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.311585 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.314860 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.589762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-334fb8ef-0be7-45ca-b3f8-4af5928f86e1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 29738 microversion: 2.20 time: 0.327369 May 18 01:40:26.594482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 156/343] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:26 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 29738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:26.869141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:26.869921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:26.889892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.890644 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.896636 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.897475 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.943189 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:26.944170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:26.966773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.972930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:26.974154 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:26.980077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.474732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:27.488336 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bc865d9b-c8f0-43eb-a814-9c9d8ec8e3ea tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.624275 May 18 01:40:27.492623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 188/344] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:26 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:27.508835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:27.509583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:27.530074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.530537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.531336 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.531768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.547952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:27.562343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a8d51040-8fbd-449f-ac96-45973bec3e06 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1515 microversion: 2.1 time: 0.623346 May 18 01:40:27.567011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 157/345] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:26 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1515 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:27.575663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:27.585081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:27.606104 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.608938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.613193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.615597 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.752676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3e2b96dd-8d20-457f-94c5-2a89edb353bf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 34527 microversion: 2.1 time: 0.183626 May 18 01:40:27.756861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 158/346] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:27 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 34527 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:27.759592 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f24d1673-ba31-42f3-b5db-cc1de15318a4"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:27.760794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:27.777868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.779001 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.779985 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.780633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.813090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:27.828689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-01156677-a645-418c-b744-28ad2ec3dd88 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.332533 May 18 01:40:27.836807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 189/347] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:27 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:27.849116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:27.851192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:27.873957 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.874912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:27.876162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:27.876973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:28.050079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-995135a3-9de6-4d99-8530-0beef5e46869 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 30690 microversion: 2.20 time: 0.210231 May 18 01:40:28.054091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 190/348] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:27 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 30690 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:28.495837 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c95feacd-ac3f-4397-89c1-8c1f870857e8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740115 May 18 01:40:28.496596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 159/349] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:27 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:28.520893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:28.521623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:28.551978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:28.552485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:28.555736 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:28.556568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:28.766088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:28.767132 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:28.784785 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:28.785256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:28.786065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:28.786682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:28.973280 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:28.983747 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2fcd4219-672f-43a2-bb68-dec4cba6f5cb tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.474569 May 18 01:40:28.985124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 191/350] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:28 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:28.991089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:28.991758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:29.001209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:29.001674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:29.002466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:29.002906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:29.104781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a815421b-725c-4899-8a7b-7b7a7b567328 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 34971 microversion: 2.1 time: 0.342324 May 18 01:40:29.110096 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 160/351] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:28 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 34971 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:29.115504 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:29.116560 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:29.125547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:29.126014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:29.126818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:29.127262 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:29.290112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4098df89-a914-4444-8b04-ec6b1c65a87b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 31719 microversion: 2.20 time: 0.178436 May 18 01:40:29.292541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 161/352] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:29 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 31719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:29.299764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-fe0bf4fe-ec99-45ad-a603-d379696ab461 req-18cf3baf-fb4a-49b9-a726-d88dbc30cbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cf130e-863e-4500-825d-e7058ff7f7bb", "tag": "e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:29.301615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:29.301615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:40:29.323847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-fe0bf4fe-ec99-45ad-a603-d379696ab461 req-18cf3baf-fb4a-49b9-a726-d88dbc30cbda service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:29.325091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-fe0bf4fe-ec99-45ad-a603-d379696ab461 req-18cf3baf-fb4a-49b9-a726-d88dbc30cbda service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:29.349631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-fe0bf4fe-ec99-45ad-a603-d379696ab461 req-18cf3baf-fb4a-49b9-a726-d88dbc30cbda service nova] Creating event network-changed:e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd for instance 11cf130e-863e-4500-825d-e7058ff7f7bb on hv-cinder-78462 May 18 01:40:29.352428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:29.356198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-fe0bf4fe-ec99-45ad-a603-d379696ab461 req-18cf3baf-fb4a-49b9-a726-d88dbc30cbda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061423 May 18 01:40:29.357481 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 162/353] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:29.363560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-96671597-23e9-45ec-9cfe-327035b95952 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.376483 May 18 01:40:29.365189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 192/354] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:28 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:30.006009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:30.007406 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:30.033882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.034542 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.035712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.036447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.118294 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:30.119978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:30.145162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.145645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.147872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.148228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.392092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d18fd043-59fc-4d70-aad5-608d611e3f2a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 35637 microversion: 2.1 time: 0.277911 May 18 01:40:30.393320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 193/355] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:30 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 35637 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:30.402266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:30.404660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:30.422980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.424616 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.425474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.425932 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.435254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:30.450231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-de6a6a24-02fb-4ac4-8c43-ec3aa875f36a tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.448369 May 18 01:40:30.451522 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 163/356] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:29 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:30.456676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:30.457860 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:30.467652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.468582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.470583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.471245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.622171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-58c3bf12-ee21-4b31-b169-ec80cf400102 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 32693 microversion: 2.20 time: 0.226937 May 18 01:40:30.626137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 194/357] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:30 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 32693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:30.633750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-8362f843-bc72-48cd-b1c1-f57b1d41d56a req-2f9e0caf-a030-42de-b044-8a9b0701ab4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014efcc0-20a4-4ce5-b190-6c53a3098130", "name": "network-vif-plugged", "status": "completed", "tag": "4471f092-4c32-4127-841f-194070f04887"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:30.639509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:30.639509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:40:30.652145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-8362f843-bc72-48cd-b1c1-f57b1d41d56a req-2f9e0caf-a030-42de-b044-8a9b0701ab4b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:30.652883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-8362f843-bc72-48cd-b1c1-f57b1d41d56a req-2f9e0caf-a030-42de-b044-8a9b0701ab4b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:30.678247 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-8362f843-bc72-48cd-b1c1-f57b1d41d56a req-2f9e0caf-a030-42de-b044-8a9b0701ab4b service nova] Creating event network-vif-plugged:4471f092-4c32-4127-841f-194070f04887 for instance 014efcc0-20a4-4ce5-b190-6c53a3098130 on hv-cinder-78462 May 18 01:40:30.685365 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-8362f843-bc72-48cd-b1c1-f57b1d41d56a req-2f9e0caf-a030-42de-b044-8a9b0701ab4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061083 May 18 01:40:30.686259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 195/358] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:30.849715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:30.863447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2ad0ec77-59da-4658-8068-bfc41df677e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.410562 May 18 01:40:30.864241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 164/359] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:30 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:31.411832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:31.413053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:31.421759 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.422228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.423037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.423488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.468360 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:31.470682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:31.481222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.481912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.483039 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.483632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.564938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4d80c5dc-12ba-49a3-a531-e6b34a709c0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 36205 microversion: 2.1 time: 0.158252 May 18 01:40:31.566506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 196/360] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:31 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 36205 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:31.635852 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:31.636945 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:31.645099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.645749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.646793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.647387 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.755535 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:31.766471 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0f9babd9-4430-4d38-acfc-169476b03b71 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1314 microversion: 2.1 time: 0.302240 May 18 01:40:31.767049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 165/361] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:31 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:31.782577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1bb4ce6e-f609-4cb7-90f3-af8666a6b79c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 33305 microversion: 2.20 time: 0.150237 May 18 01:40:31.783910 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 197/362] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:31 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 33305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:31.881011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:31.882004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:31.890635 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.891409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:31.892754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:31.893365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.303325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:32.315155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fe129e9f-8afb-40b4-b7d6-70d1f404f4fe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.437784 May 18 01:40:32.327312 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 166/363] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:31 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:32.578842 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:32.579898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:32.597092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.597716 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.598377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.598828 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.745507 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5ea37e00-43b0-4c3a-b186-f9bfb0f20ed5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 36713 microversion: 2.1 time: 0.170091 May 18 01:40:32.746128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 198/364] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:32 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 36713 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:32.790096 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:32.796047 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:32.796690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:32.803944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:32.812225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.813980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.814438 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.815251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.815689 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.835600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:32.836538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:32.836999 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.063074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f42c6080-e709-49c9-b8ed-a52999012da9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 33672 microversion: 2.20 time: 0.270823 May 18 01:40:33.064425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 199/365] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:32 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 33672 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:33.192522 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:33.203016 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f7d9efe6-617e-49e0-832d-dd20154720a8 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1463 microversion: 2.1 time: 0.417721 May 18 01:40:33.204401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 167/366] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:32 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1463 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:33.293876 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:33.294471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:33.308513 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.308980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.309787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.310330 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.333188 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:33.334743 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:33.351097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.352059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.355988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.357875 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.390041 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:40:33.549391 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b70e34b8-9a48-4a76-9d26-380a48290bca tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "DELETE /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 204 len: 0 microversion: 2.1 time: 0.260626 May 18 01:40:33.554847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 200/367] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:40:33 2021] DELETE /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:40:33.562841 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:33.564033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:33.576874 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.577767 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.579449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.581218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.602136 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:33.612922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-36416e92-0470-4664-8b69-147513a2066f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.283167 May 18 01:40:33.613776 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 168/368] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:33 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:33.763101 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:33.764599 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:33.780032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.784122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.785218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:33.785733 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:33.897953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:33.919076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-64394599-c10f-424e-a551-47c47b2a0c16 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1469 microversion: 2.1 time: 0.361936 May 18 01:40:33.922243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 201/369] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:33 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:33.953159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2e9599d6-455f-4ea4-a2cf-5e291018772c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 37709 microversion: 2.1 time: 0.196261 May 18 01:40:33.958785 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 169/370] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:33 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 37709 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:40:34.075994 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:34.077310 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:34.085814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.086612 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.088964 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.089694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.242698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9cd77bf2-d7ed-45ea-a7ef-bae42c04553c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 34033 microversion: 2.20 time: 0.170591 May 18 01:40:34.245501 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 202/371] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:34 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 34033 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:34.630796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:34.631781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:34.650537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.654427 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.655719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.657289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.940900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:34.941730 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:34.954952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.955415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.956209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.956679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.971081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:34.980011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d473ef80-f6cb-4e14-9a07-5d41703e7790 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.353637 May 18 01:40:34.981155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 170/372] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:34 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:34.986246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:34.987525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:34.996119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.996867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:34.997827 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:34.998444 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:35.133041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0d00c630-ea52-4445-9684-a3804f41da6f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 38098 microversion: 2.1 time: 0.149837 May 18 01:40:35.137638 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 171/373] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:34 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 38098 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:35.180174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:35.192861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a60461ef-0fa8-43bc-a0da-069f8384d528 tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1469 microversion: 2.1 time: 0.257221 May 18 01:40:35.203562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 203/374] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:34 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:35.257862 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:35.259238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:35.269314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:35.269819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:35.270755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:35.271536 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:35.420662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-80fcc705-1419-4cd4-b431-3ee8dd9b04ba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 34388 microversion: 2.20 time: 0.168824 May 18 01:40:35.425477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 172/375] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:35 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 34388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:35.999687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:36.000639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:36.017633 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.020239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.022393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.022953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.150771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:36.152534 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:36.178678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.179343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.180469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.181631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.365894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0578596e-1c06-4915-beca-66884bfeb709 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 38098 microversion: 2.1 time: 0.219475 May 18 01:40:36.367282 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 173/376] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:36 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 38098 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:36.372762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:36.376557 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:36.397200 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.397953 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.398936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.399523 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.479065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:36.490100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0108ca65-5ba8-4ada-8753-a6c3ea5647e3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.496621 May 18 01:40:36.491532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 204/377] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:35 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:36.497805 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-3995c84c-65ad-4ad2-89b8-f7f39e31ac1f req-fc3aaa65-a600-4036-80aa-392454bca3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cf130e-863e-4500-825d-e7058ff7f7bb", "name": "network-vif-plugged", "status": "completed", "tag": "e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:36.499856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:36.499856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:40:36.510540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3995c84c-65ad-4ad2-89b8-f7f39e31ac1f req-fc3aaa65-a600-4036-80aa-392454bca3db service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.511346 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3995c84c-65ad-4ad2-89b8-f7f39e31ac1f req-fc3aaa65-a600-4036-80aa-392454bca3db service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.540378 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-3995c84c-65ad-4ad2-89b8-f7f39e31ac1f req-fc3aaa65-a600-4036-80aa-392454bca3db service nova] Creating event network-vif-plugged:e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd for instance 11cf130e-863e-4500-825d-e7058ff7f7bb on hv-cinder-78462 May 18 01:40:36.546509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-3995c84c-65ad-4ad2-89b8-f7f39e31ac1f req-fc3aaa65-a600-4036-80aa-392454bca3db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053416 May 18 01:40:36.547770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 205/378] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:36.560723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:36.562055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:36.571062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.571604 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.572649 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.573087 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.691715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0c4ecbb3-fc7a-4256-800e-69100b0d4693 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 35138 microversion: 2.20 time: 0.136017 May 18 01:40:36.692840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 206/379] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:36 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 35138 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:36.744865 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:36.746004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:36.755126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.755578 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.756393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:36.756836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:36.837327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lazy-loading 'flavor' on Instance uuid dca767d8-1b78-4c0e-a024-8c965bbc81fb {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:40:37.084604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c53a1f58c3437c96515e44d7fdc79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7700d14079481982fb6ae9a18c6224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:37.096136 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2163a67e-8bc4-47a7-985b-7c483557560d tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 200 len: 1469 microversion: 2.1 time: 0.727385 May 18 01:40:37.096756 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 174/380] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:36 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 1469 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:37.175340 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-a7e55c4f-ce21-4a3f-8992-2c52e8b71682 req-82747359-b05c-4576-b56b-43c39dbfe74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014efcc0-20a4-4ce5-b190-6c53a3098130", "name": "network-vif-deleted", "tag": "4471f092-4c32-4127-841f-194070f04887"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:37.177545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:40:37.177545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:40:37.192815 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a7e55c4f-ce21-4a3f-8992-2c52e8b71682 req-82747359-b05c-4576-b56b-43c39dbfe74f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.193278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a7e55c4f-ce21-4a3f-8992-2c52e8b71682 req-82747359-b05c-4576-b56b-43c39dbfe74f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.236490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-a7e55c4f-ce21-4a3f-8992-2c52e8b71682 req-82747359-b05c-4576-b56b-43c39dbfe74f service nova] Creating event network-vif-deleted:4471f092-4c32-4127-841f-194070f04887 for instance 014efcc0-20a4-4ce5-b190-6c53a3098130 on hv-cinder-78462 May 18 01:40:37.259284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-a7e55c4f-ce21-4a3f-8992-2c52e8b71682 req-82747359-b05c-4576-b56b-43c39dbfe74f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088233 May 18 01:40:37.276839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 175/381] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:40:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:40:37.380855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:37.382445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:37.399384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bca1514b-4d01-4b7c-9f23-0f52d08708b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action" status: 200 len: 32 microversion: 2.1 time: 0.659363 May 18 01:40:37.407316 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.407871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.408763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 207/382] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:36 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:40:37.411690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.412217 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.416802 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:37.417526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:37.426080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.426913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.427703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.428146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.599247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-969b9565-c7ee-487b-8a4f-5657ecf9dba6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 38103 microversion: 2.1 time: 0.222726 May 18 01:40:37.599811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 176/383] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:37 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 38103 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:37.611376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:37.612275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:37.629200 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.630574 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.634551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.636992 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.930849 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:37.946506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-38d3e4c8-8c1d-461a-aef8-5740b9c8e115 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.536672 May 18 01:40:37.966549 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 208/384] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:37 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:37.972083 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:37.973115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:37.992213 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.992835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:37.994227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:37.995045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.171032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ed3be386-98ac-4904-b787-1f3faa46c69d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 36032 microversion: 2.20 time: 0.202949 May 18 01:40:38.171695 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 209/385] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:37 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 36032 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:38.175679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:38.177246 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:38.178105 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] [instance: 014efcc0-20a4-4ce5-b190-6c53a3098130] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:38.186584 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-99168019-38b6-4b98-88e1-786586114a56 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1317 microversion: 2.1 time: 0.585340 May 18 01:40:38.189781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 177/386] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:37 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:38.207341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.207800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.208649 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.209091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.298924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] HTTP exception thrown: Instance 014efcc0-20a4-4ce5-b190-6c53a3098130 could not be found. May 18 01:40:38.299918 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] Returning 404 to user: Instance 014efcc0-20a4-4ce5-b190-6c53a3098130 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:40:38.301053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-41a54cb4-4c2a-4181-9f87-a61f287f37bf tempest-VolumesNegativeTest-709165158 tempest-VolumesNegativeTest-709165158-project] 10.222.0.16 "GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130" status: 404 len: 111 microversion: 2.1 time: 0.128034 May 18 01:40:38.301837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 210/387] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:38 2021] GET /compute/v2.1/servers/014efcc0-20a4-4ce5-b190-6c53a3098130 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:40:38.612792 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:38.613731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:38.628153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.631572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.632442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.632968 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.769829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1733f106-a2c3-44e3-9aea-098cfe6e1fa7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 200 len: 38228 microversion: 2.1 time: 0.160852 May 18 01:40:38.770950 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 178/388] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:40:38 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 38228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:38.781462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:38.782094 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:38.793693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.796032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.798077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:38.799208 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:38.895198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1c02a58e-15d6-4c9a-94b1-1dec1bbc20e7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/ips" status: 200 len: 146 microversion: 2.1 time: 0.117423 May 18 01:40:38.896791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 211/389] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:40:38 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/ips => generated 146 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:38.979077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:38.983056 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:39.005669 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.009000 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.011581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.013119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.185136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:39.186911 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:39.207675 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.208711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.211538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.214193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.396755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:39.413522 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-696bffa0-ebfe-4e35-8f58-7c2daf3d4484 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.441126 May 18 01:40:39.414822 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 179/390] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:38 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:39.421335 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:39.422458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:39.434330 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.435057 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.436137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:39.436759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:39.439886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4c92acce-e7c5-4923-a643-ada0e5534e17 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 36907 microversion: 2.20 time: 0.259597 May 18 01:40:39.444776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 212/391] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:39 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 36907 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:39.682724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:39.692294 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3bfd5a3a-2bb4-4bd0-8d14-a084c2babf38 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1507 microversion: 2.1 time: 0.275405 May 18 01:40:39.693070 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 180/392] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:39 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:40.434527 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:40.447753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:40.453845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:40.454904 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:40.472569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:40.473047 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:40.474357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:40.474878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:40.477754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:40.478324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:40.479054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:40.479387 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:40.695517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2d4f8d75-cd61-4f1d-b534-943bef63ceea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 37972 microversion: 2.20 time: 0.245970 May 18 01:40:40.697331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 181/393] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:40 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 37972 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:40.798407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:40.810536 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-91828d89-4651-4da8-bae9-cb5fbb87efb8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.380942 May 18 01:40:40.811648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 213/394] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:40 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:41.490030 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e386a8b-84f6-44f1-9c98-19a3db856a42"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:41.491198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:41.500545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.501013 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:41.501938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.502530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:41.708217 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:41.709172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:41.717915 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.718606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:41.719832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.720639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:41.854863 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ba8863b3-8e1c-48e0-a727-d99990256e3c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 38241 microversion: 2.20 time: 0.150089 May 18 01:40:41.855550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 214/395] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:41 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 38241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:41.860963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:41.861677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:41.869643 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.870310 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:41.871098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:41.871545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:42.012829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0025ba12-aef6-425f-b999-cac8b325f8b0 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "POST /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526326 May 18 01:40:42.013695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 182/396] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:41 2021] POST /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:40:42.121710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:42.128164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1056c7d4-d30f-41aa-be50-0a6853d276bd"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:42.129491 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:42.134381 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e9680567-0d78-4380-9275-c199c94135d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.275920 May 18 01:40:42.145542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 215/397] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:41 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:42.301180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:42.301652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:42.302461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:42.302905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:42.867122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:42.867967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:42.876131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:42.876628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:42.877405 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:42.877847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:42.969597 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e1d4ad5a-e1df-447b-9e7f-de7f121089c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845616 May 18 01:40:42.970440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 183/398] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:40:42 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:40:43.003593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9af7625b-5853-4bd3-8e35-7b09d9ce2405 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 38248 microversion: 2.20 time: 0.140181 May 18 01:40:43.004929 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 216/399] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:42 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 38248 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:40:43.153209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:43.154045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:43.163293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:43.163873 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:43.164809 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:43.166021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:43.387303 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:43.397800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2832c66a-cc02-469a-ac34-ba0aaf49ca1c tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.250252 May 18 01:40:43.398615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 184/400] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:43 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:44.015856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:44.016912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:44.025732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.026196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.026988 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.027615 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.137014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d3cc0b66-ed36-4c6e-93e4-f58719be9913 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 200 len: 38382 microversion: 2.20 time: 0.125052 May 18 01:40:44.138276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 217/401] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:44 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 38382 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:44.147942 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:44.148497 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:44.156974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.157328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.158273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.158857 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.221317 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-39d9bc29-c89b-49ce-8359-6a591adc0177 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/ips" status: 200 len: 153 microversion: 2.20 time: 0.076991 May 18 01:40:44.226991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 185/402] 10.222.0.16 () {60 vars in 1289 bytes} [Tue May 18 01:40:44 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/ips => generated 153 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:40:44.417733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:44.418646 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:44.427664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.428138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.429069 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:44.429490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:44.841946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:44.851171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-078d4617-0e19-43ab-a9c9-fa0510bd9698 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.438034 May 18 01:40:44.851731 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 218/403] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:44 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:45.870556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:45.871852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:45.879247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:45.879785 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:45.880695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:45.881369 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:46.121171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:46.129829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c7a6dd27-60e6-46b2-a1cd-2af801d6d119 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.264513 May 18 01:40:46.130407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 186/404] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:45 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:46.658100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:46.658779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:46.667152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:46.667614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:46.668531 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:46.669101 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:46.729487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lazy-loading 'flavor' on Instance uuid 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:40:47.147544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:47.148383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:47.157199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:47.157653 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:47.158722 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:47.159174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:47.173787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6f4180a9-50ff-4985-8366-858e54907496 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 202 len: 0 microversion: 2.20 time: 0.519366 May 18 01:40:47.175471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 219/405] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:40:46 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 01:40:47.185271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:47.187303 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:47.211854 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:47.213109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:47.214799 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:47.215436 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:47.562310 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:47.572954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-335e1c97-0494-41d4-905b-fd06a74af5a8 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.429148 May 18 01:40:47.573635 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 187/406] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:47 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:47.600665 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:47.620845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:47.620845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:47.620845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0468d73f-21cb-4310-99e0-876ee9d4e998 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.435104 May 18 01:40:47.621085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 220/407] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:47 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:48.591109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:48.592647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:48.605240 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:48.605944 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:48.606786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:48.607394 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:48.634868 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:48.636412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:48.650654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:48.651492 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:48.652757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:48.661561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:49.272059 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:49.288168 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:49.290043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:49.297290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1b2f5c97-78c5-40dc-ac82-d874fcbef2a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.667045 May 18 01:40:49.298733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 221/408] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:48 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:49.339068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:49.351935 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b86291e5-be00-4034-b9c2-00a388075e15 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.765106 May 18 01:40:49.353515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 188/409] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:48 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:50.320324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:50.320858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:50.328567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.329025 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.329810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.330248 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.371032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:50.371793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:50.379066 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.379588 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.380398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.380829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.636327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:50.640622 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:50.649865 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-877a1e07-de58-4942-bc9a-c1b3f8a9da35 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.282626 May 18 01:40:50.650417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 189/410] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:50 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:40:50.650773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:50.652552 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:50.653871 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-eaa26cb1-863e-4f5d-8905-ff3bdb1985a6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.337518 May 18 01:40:50.654409 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 222/411] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:50 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:40:50.659339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:50.659339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:50.662496 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.662974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.663736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:50.664168 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:50.869368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lazy-loading 'services' on Instance uuid 11cf130e-863e-4500-825d-e7058ff7f7bb {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:40:51.011118 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-93611e7c-1d1a-4794-94ae-d0a47e065be1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb/os-volume_attachments/6e386a8b-84f6-44f1-9c98-19a3db856a42" status: 202 len: 0 microversion: 2.1 time: 0.359453 May 18 01:40:51.011703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 190/412] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:40:50 2021] DELETE /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb/os-volume_attachments/6e386a8b-84f6-44f1-9c98-19a3db856a42 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:40:51.666395 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:51.667015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:51.672236 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:51.673190 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:51.674261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:51.674708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:51.675485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:51.675985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:51.681538 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:51.682106 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:51.683013 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:51.683610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:51.972785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:51.975705 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:51.981925 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a25e32e5-13d6-414f-8f7b-ac1538ad39a3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.319242 May 18 01:40:51.982691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 223/413] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:51 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:51.984569 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:51.986097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:51.987229 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c7ec4a07-04d6-4775-833f-8637722c7dba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.319786 May 18 01:40:51.987765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 191/414] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:51 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:53.000941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:53.001674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:53.005403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:53.006033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:53.010756 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.011344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.012257 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.012834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.015210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.015670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.016548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.017007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.314394 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:53.323378 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-27109663-21e3-4c5f-a828-72b67f5a8c96 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.327749 May 18 01:40:53.323655 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:53.323996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 224/415] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:52 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:53.328652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1681262672", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "d65b85fd-08c9-43e8-8336-2db4b9430060"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:40:53.333654 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:53.335498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:53.336861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-26bd5406-077d-4ef1-96f3-014355a2675d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.335243 May 18 01:40:53.337572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 192/416] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:53 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:53.395111 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] validate_networks() for [('d65b85fd-08c9-43e8-8336-2db4b9430060', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:40:53.941305 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:40:53.941828 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:40:53.942574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:40:53.943169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:40:53.943667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:40:53.952789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.953273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.954080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:53.954521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:53.975263 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Getting quotas for project d7a4c6597af74bf0998a3927c38e3b52. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:40:53.985423 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Getting quotas for user b3a9ccca964e43f1b372795036241958 and project d7a4c6597af74bf0998a3927c38e3b52. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:40:53.998860 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:40:54.001808 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:40:54.048484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3eeeeb1e-4d3b-43a2-b782-7568e26cee5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723314 May 18 01:40:54.049126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 225/417] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:40:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:40:54.059285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9b1e944c-eabd-40e4-8af7-c700b78dd301 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:54.059907 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9b1e944c-eabd-40e4-8af7-c700b78dd301 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:54.130297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9b1e944c-eabd-40e4-8af7-c700b78dd301 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:54.139176 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9b1e944c-eabd-40e4-8af7-c700b78dd301 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1219 microversion: 2.1 time: 0.084002 May 18 01:40:54.139733 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 193/418] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:54 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:54.343745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:54.343745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:54.352004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:54.353142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:54.354209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:54.354651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:54.355235 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:54.355860 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:54.363664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:54.364441 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:54.365467 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:54.366058 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:54.667862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:54.671275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:54.676909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8ceca86a-a939-4178-9433-fd13aaeac1a0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.339358 May 18 01:40:54.677482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 226/419] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:54 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:54.680294 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:54.682396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:54.683557 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d5c97ed6-e4f2-4942-a10a-7f6e98674b54 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.332614 May 18 01:40:54.684091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 194/420] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:54 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:55.155906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:55.156555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:55.163714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.164172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.165002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.165447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.278485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:55.286486 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b385bdb2-77d4-457d-a7f8-572e0d7feb45 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1223 microversion: 2.1 time: 0.134302 May 18 01:40:55.287048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 227/421] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:55 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:55.694709 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:55.695314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:55.702069 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:55.702710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:55.703435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.703884 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.704680 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.705113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.709781 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.710497 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.711258 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:55.712341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:55.991354 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:55.998590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:56.000790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-726f8a86-fff2-4efb-906e-5f3c7038cbb6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.309721 May 18 01:40:56.001367 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 195/422] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:55 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:56.007742 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:56.009930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:56.011080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-840ceb65-3f8a-475b-8b34-452604a543f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.312669 May 18 01:40:56.011631 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 228/423] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:55 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:56.303997 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:56.304591 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:56.312371 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:56.312825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:56.313594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:56.314034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:56.425885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:56.434518 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-64142582-9a08-434e-a0bf-d059fd7de23e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1223 microversion: 2.1 time: 0.134346 May 18 01:40:56.435075 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 196/424] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:56 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:57.017985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:57.018634 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:57.026545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.027004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.027788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.028238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.029375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:57.029987 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:57.037037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.037483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.038245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.038678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.319408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:57.329269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5de18c2f-0ca8-450b-898d-7fcc729b8482 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.314932 May 18 01:40:57.329837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 229/425] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:57 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:57.329947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:57.339771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:57.341343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:57.342611 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-80b6dc66-8448-4f3c-aefd-993742be0cba tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.316831 May 18 01:40:57.343297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 197/426] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:57 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:57.451406 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:57.452023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:57.459499 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.460264 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.461125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:57.461691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:57.575637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:57.583855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-861ef878-dc8b-405a-a502-668d2a95f3b9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1271 microversion: 2.1 time: 0.136195 May 18 01:40:57.584450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 230/427] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:57 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:58.346856 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:58.348071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:58.356632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.357303 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.358255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.358915 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.363140 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:58.363874 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:58.373461 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.374038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.374981 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.375558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.923351 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:58.932885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a2cd1025-7fa4-4d1f-927f-6086d63fa093 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.589533 May 18 01:40:58.933710 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 198/428] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:58 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:58.938246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:58.938855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:58.946698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:58.947343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.947806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.948891 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:58.949515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:58.958705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:58.960715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:58.962880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6a67c151-c309-4b38-b208-9a588a2522a5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.604797 May 18 01:40:58.964656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 231/429] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:58 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:40:59.287261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:40:59.296007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b82c5222-7af8-4bb9-bc6f-f9ef3e77c269 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.361054 May 18 01:40:59.296626 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 199/430] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:58 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:40:59.956185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:59.956185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:59.958430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:59.958960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:59.960388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:59.960839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:59.982988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:40:59.983598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:40:59.991487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:59.991938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:40:59.993023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:40:59.993461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:00.253738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:00.260876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:00.263757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ce1b934b-2b03-49f1-a473-fe4929682f28 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.317071 May 18 01:41:00.264462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 232/431] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:40:59 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:00.269715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:00.271244 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:00.272398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2f1b17d2-2a97-492a-be46-d70a660e6793 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.293180 May 18 01:41:00.272939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 200/432] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:40:59 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:00.313578 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:00.314228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:00.322017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:00.322467 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:00.323241 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:00.323682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:00.516034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:00.524275 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-25c9e5a3-b375-4060-bc67-e212de2fd440 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.214261 May 18 01:41:00.524860 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 233/433] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:00 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:01.280819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:01.281470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:01.288890 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.289299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.290660 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.291103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.292145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:01.292810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:01.300196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.301040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.301831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.302406 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.826251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:01.835109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-611e396e-6740-4199-8940-bfc81fbc0b2e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.557727 May 18 01:41:01.844683 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 201/434] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:01 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:01.844869 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:01.845008 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:01.845008 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:01.848495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.848958 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.849746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:01.850216 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:01.853951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:01.855526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:01.857264 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-57cecf27-94e6-4f0c-a8a1-c4f0d2d33a20 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.569770 May 18 01:41:01.858035 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 234/435] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:01 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:02.000669 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-38e248f0-10b7-47bd-91e3-df39f5b6c001 req-901b54d6-de73-4e34-872e-22ef5425b525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce5ffd-6939-4076-a83e-65d02e86f150", "tag": "a362a6cf-27f8-4883-9ad3-52e416d7cef1"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:02.002442 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:02.002442 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:02.011930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-38e248f0-10b7-47bd-91e3-df39f5b6c001 req-901b54d6-de73-4e34-872e-22ef5425b525 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:02.012753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-38e248f0-10b7-47bd-91e3-df39f5b6c001 req-901b54d6-de73-4e34-872e-22ef5425b525 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:02.037667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-38e248f0-10b7-47bd-91e3-df39f5b6c001 req-901b54d6-de73-4e34-872e-22ef5425b525 service nova] Creating event network-changed:a362a6cf-27f8-4883-9ad3-52e416d7cef1 for instance 87ce5ffd-6939-4076-a83e-65d02e86f150 on hv-cinder-78462 May 18 01:41:02.043030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-38e248f0-10b7-47bd-91e3-df39f5b6c001 req-901b54d6-de73-4e34-872e-22ef5425b525 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046228 May 18 01:41:02.044388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 235/436] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:41:02.189850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:02.198053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ff853855-d792-409c-a3b5-aa5230dcbbce tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.361135 May 18 01:41:02.198620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 202/437] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:01 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:02.854867 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:02.855598 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:02.864921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:02.865322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:02.866119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:02.866558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:02.876667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:02.877462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:02.885602 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:02.886202 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:02.886998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:02.887615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:03.378318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:03.388705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-dbe9e071-0bda-4c2a-ae30-dc9305c7379e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1567 microversion: 2.1 time: 0.538561 May 18 01:41:03.399717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 236/438] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:02 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1567 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:03.404751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d2edfa7f-00ca-4867-bc47-2ba9ad3ba55b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:03.412007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2edfa7f-00ca-4867-bc47-2ba9ad3ba55b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:03.412505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d2edfa7f-00ca-4867-bc47-2ba9ad3ba55b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:03.455304 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:03.468229 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:03.470101 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:03.471426 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6612c34f-6d0a-4ad5-8c67-e0c50f41792b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.599036 May 18 01:41:03.472677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 203/439] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:02 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:03.481498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d2edfa7f-00ca-4867-bc47-2ba9ad3ba55b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Going to try to stop instance {{(pid=92949) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 18 01:41:03.492649 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:03.493640 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:03.506413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:03.506870 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:03.507652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:03.508138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:03.566723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d2edfa7f-00ca-4867-bc47-2ba9ad3ba55b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 202 len: 0 microversion: 2.1 time: 0.165589 May 18 01:41:03.567615 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 237/440] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:41:03 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:41:03.577151 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:03.577912 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:03.589537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:03.591098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:03.592167 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:03.592704 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.027643 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.035770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.036457 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ef6b6966-31d1-45a8-ba01-cf9418aedf9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.463515 May 18 01:41:04.037036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 238/441] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:03 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:04.044278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b31329a8-84d4-448c-913b-280a284ba9d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.569976 May 18 01:41:04.044874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 204/442] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:03 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:04.406032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:04.406659 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:04.413810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.414814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.415719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.416163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.490998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:04.491752 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:04.501566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.502025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.502817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.503262 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.676244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.689148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-64cee7d9-e47f-4534-8c60-65df5d518aeb tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1547 microversion: 2.1 time: 0.286710 May 18 01:41:04.689907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 239/443] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:04 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1547 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:04.706920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:04.707434 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:04.715833 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.716473 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.717102 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.717533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.755321 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.764517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.766113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:04.767332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fcf3f85f-a943-45be-ae4d-f176ce67f1d3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.280319 May 18 01:41:04.767977 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 205/444] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:04 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:04.886619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] HTTP exception thrown: Cannot 'detach_volume' instance dca767d8-1b78-4c0e-a024-8c965bbc81fb while it is in vm_state rescued May 18 01:41:04.887229 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Returning 409 to user: Cannot 'detach_volume' instance dca767d8-1b78-4c0e-a024-8c965bbc81fb while it is in vm_state rescued {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:04.888077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-08785575-6c29-49c6-a1d3-e1a6545fb178 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments/f24d1673-ba31-42f3-b5db-cc1de15318a4" status: 409 len: 152 microversion: 2.1 time: 0.185454 May 18 01:41:04.888669 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 240/445] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:41:04 2021] DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments/f24d1673-ba31-42f3-b5db-cc1de15318a4 => generated 152 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 01:41:04.897049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:04.897704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:04.907618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.908042 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:04.915411 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:04.915847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.052951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.053647 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.055708 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-be0b6cc3-b44b-403d-be49-1e04f1bc6237 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action" status: 202 len: 0 microversion: 2.1 time: 0.162189 May 18 01:41:05.059608 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 206/446] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:41:04 2021] POST /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:41:05.062098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.062336 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.062551 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.063187 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.063327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.063761 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.071788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.072270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.073180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.073664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.484827 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:05.493476 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fe6348c3-cc8f-454b-8435-6dba90be0800 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.444217 May 18 01:41:05.494045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 241/447] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:05 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:05.498436 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.499052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.502573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:05.506249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.506709 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.507494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.507977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.512577 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1888c7d0-27ba-484d-a46c-bb567d55bb9f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.454643 May 18 01:41:05.513553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 207/448] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:05 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:05.612246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.612852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.620347 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.620803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.621589 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.622031 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.681800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:05.800598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0f4aec1f-70f9-4b6c-8703-846fa1fbcffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 204 len: 0 microversion: 2.1 time: 0.191613 May 18 01:41:05.802158 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 208/449] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:05 2021] DELETE /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 01:41:05.809076 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.810086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.817417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.818085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.818878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.819322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.929514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:05.942653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2aa54a5d-62f7-4d7f-ad6a-fee1d08b88d3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1555 microversion: 2.1 time: 0.447562 May 18 01:41:05.943805 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 242/450] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:05 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:05.950941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:05.951735 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:05.962925 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.963636 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:05.964611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:05.965255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.306270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.315485 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.317155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.318299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d8c25607-1c49-46e1-8aa6-bf6903f5bab4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.514267 May 18 01:41:06.318852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 209/451] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:05 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:06.379907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.388424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6685fa2a-bafa-44f8-8930-fed072358831 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1513 microversion: 2.1 time: 0.443271 May 18 01:41:06.388987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 243/452] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:05 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:06.510302 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:06.510917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:06.518192 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.518643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.519410 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.519847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.529123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:06.529736 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:06.537011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.537562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.538331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.538768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.809607 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.819762 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:06.823348 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-77cea662-a6cc-42bb-9389-b5ebef67da32 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.316656 May 18 01:41:06.824154 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 210/453] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:06 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:06.829158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-60fc2461-501a-41c9-8246-6ccf575ece8a tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.303590 May 18 01:41:06.829831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 244/454] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:06 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:06.960191 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:06.960967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:06.969443 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.969999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:06.970902 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:06.971474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.173015 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:07.181837 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-52d545f2-d444-42cd-9682-3ae47e1ce882 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1555 microversion: 2.1 time: 0.225997 May 18 01:41:07.182403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 211/455] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:06 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:07.337290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:07.338627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:07.347348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.347892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.348773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.349254 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.405571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:07.406242 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:07.413862 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.414454 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.415435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.415878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.642500 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:07.652207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:07.653768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:07.654906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bf279b24-b455-4d65-aafe-d68e5c2f4bfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.322113 May 18 01:41:07.655490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 245/456] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:07 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:07.661842 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:07.670146 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-05414f29-cafc-4267-bddb-317c252fd5f7 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1513 microversion: 2.1 time: 0.268482 May 18 01:41:07.670700 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 212/457] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:07 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:07.840796 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:07.841410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:07.846613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:07.847231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:07.848691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.849142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.849916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.850426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.855517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.856107 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:07.857002 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:07.857499 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.135134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:08.143581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-48555a6a-1387-4088-8ce2-915e40e71c36 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.300676 May 18 01:41:08.144165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 213/458] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:07 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:08.145537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:08.157262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-57430481-5650-4771-96c0-9f896b54478e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.320171 May 18 01:41:08.166266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 246/459] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:07 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:08.200021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:08.200658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:08.207828 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.208275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.209067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.209510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.528837 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:08.537848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dd5900e1-8ed5-4e16-b2d5-14ab8f3d08ee tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1555 microversion: 2.1 time: 0.342188 May 18 01:41:08.538423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 214/460] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:08 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1555 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:08.673714 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:08.674913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:08.682787 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.683455 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.684250 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.684936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.686986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:08.688010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:08.697236 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.698283 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:08.699386 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:08.700007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.260050 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.268282 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fef6b014-f9a7-4af2-aa42-9d1cab92988d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 200 len: 1513 microversion: 2.1 time: 0.585421 May 18 01:41:09.268851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.269424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 215/461] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:08 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 1513 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:09.273798 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:09.274435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:09.281600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.281991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.282790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.283245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.289395 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.292242 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.293666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a315fc32-2795-4b47-b4ef-455a23f21f7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.623853 May 18 01:41:09.295810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 247/462] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:08 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:09.316600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:09.317682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:09.337045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.337713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.340062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.343119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.686657 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.692616 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.699921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e4e21957-1860-43fc-aa18-aa193d83a812 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.402603 May 18 01:41:09.700896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 248/463] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:09 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:09.705880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-30002e40-a066-4b45-80a4-c0db3a53f27e req-e089109b-2287-4200-afa4-111ee3996f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cf130e-863e-4500-825d-e7058ff7f7bb", "name": "network-vif-deleted", "tag": "e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:09.706275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9b597231-62ef-4b65-b186-6b1d300a9b62 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.435769 May 18 01:41:09.708231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:09.708231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:09.712819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 216/464] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:09 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:09.717359 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:09.717664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-30002e40-a066-4b45-80a4-c0db3a53f27e req-e089109b-2287-4200-afa4-111ee3996f20 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.717976 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:09.718454 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-30002e40-a066-4b45-80a4-c0db3a53f27e req-e089109b-2287-4200-afa4-111ee3996f20 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.731959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.732810 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.733839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:09.734378 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:09.744980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-30002e40-a066-4b45-80a4-c0db3a53f27e req-e089109b-2287-4200-afa4-111ee3996f20 service nova] Creating event network-vif-deleted:e2fbd40a-16bc-48e0-b8b9-2fe2f9b751bd for instance 11cf130e-863e-4500-825d-e7058ff7f7bb on hv-cinder-78462 May 18 01:41:09.752855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-30002e40-a066-4b45-80a4-c0db3a53f27e req-e089109b-2287-4200-afa4-111ee3996f20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050250 May 18 01:41:09.753401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 249/465] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:09.965062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:09.974848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8d104686-27a9-40bb-acbc-68302069ab82 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1561 microversion: 2.1 time: 0.260735 May 18 01:41:09.986477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 217/466] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:09 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1561 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:10.095545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:10.096142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:10.104111 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-7b5119f9-1776-4ae5-841c-c2be5521188b req-8a592a15-9aa3-4d07-89aa-e8e562879762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce5ffd-6939-4076-a83e-65d02e86f150", "name": "network-vif-plugged", "status": "completed", "tag": "a362a6cf-27f8-4883-9ad3-52e416d7cef1"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:10.105765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:10.105765 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:41:10.119191 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-7b5119f9-1776-4ae5-841c-c2be5521188b req-8a592a15-9aa3-4d07-89aa-e8e562879762 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.119640 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-7b5119f9-1776-4ae5-841c-c2be5521188b req-8a592a15-9aa3-4d07-89aa-e8e562879762 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.123922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.124593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.125544 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.126142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.168313 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-7b5119f9-1776-4ae5-841c-c2be5521188b req-8a592a15-9aa3-4d07-89aa-e8e562879762 service nova] Creating event network-vif-plugged:a362a6cf-27f8-4883-9ad3-52e416d7cef1 for instance 87ce5ffd-6939-4076-a83e-65d02e86f150 on hv-cinder-78462 May 18 01:41:10.176975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-7b5119f9-1776-4ae5-841c-c2be5521188b req-8a592a15-9aa3-4d07-89aa-e8e562879762 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076306 May 18 01:41:10.181630 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 218/467] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:10.286606 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:10.287639 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 11cf130e-863e-4500-825d-e7058ff7f7bb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:10.301631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.302892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.304273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.305710 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.351331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lazy-loading 'services' on Instance uuid dca767d8-1b78-4c0e-a024-8c965bbc81fb {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:41:10.363346 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Instance 11cf130e-863e-4500-825d-e7058ff7f7bb could not be found. May 18 01:41:10.363986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 404 to user: Instance 11cf130e-863e-4500-825d-e7058ff7f7bb could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:10.365042 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4b172bb8-ab58-4adb-99ed-c9a32dc42cfb tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb" status: 404 len: 111 microversion: 2.1 time: 0.083254 May 18 01:41:10.365730 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 219/468] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:10 2021] GET /compute/v2.1/servers/11cf130e-863e-4500-825d-e7058ff7f7bb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:41:10.371022 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:10.371687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:10.379292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.379734 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.380786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.381114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.584116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-71b2a290-4276-4b1c-8583-7735a98c0be3 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments/f24d1673-ba31-42f3-b5db-cc1de15318a4" status: 202 len: 0 microversion: 2.1 time: 0.492104 May 18 01:41:10.589642 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 250/469] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:41:10 2021] DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb/os-volume_attachments/f24d1673-ba31-42f3-b5db-cc1de15318a4 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:41:10.715739 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:10.719613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:10.720970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:10.730676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:10.732396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:10.733682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.734138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.734517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4ef0c1ba-61b9-4284-9e29-f1d5c5fdecb2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.367611 May 18 01:41:10.734927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.735362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.735703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 220/470] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:10 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:10.741764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:10.743790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:10.753085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.754024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:10.755581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:10.756445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:11.062850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:11.069844 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:11.072148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-aedc5999-be03-4620-a260-0a3c9eb0edf1 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1319 microversion: 2.1 time: 0.335013 May 18 01:41:11.072858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 221/471] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:10 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:11.079284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d07fa590-f9ab-4373-a51b-6e8619bb53a5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.365182 May 18 01:41:11.079842 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 251/472] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:10 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:11.760412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:11.760972 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:11.762698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:11.763799 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:11.775949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:11.776678 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:11.777428 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:11.777888 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:11.777999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:11.778631 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:11.779192 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:11.779934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:11.876253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:12.030842 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-13b6bfb6-7947-40c6-8312-dbf73f39018d tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 204 len: 0 microversion: 2.1 time: 0.280223 May 18 01:41:12.035697 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 222/473] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:11 2021] DELETE /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 01:41:12.043882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:12.044839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:12.055545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.055724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.056169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.057572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.058060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.068632 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.072245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.074667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6b8334f7-b079-4910-980e-7c3abe4778ea tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.320569 May 18 01:41:12.076756 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 252/474] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:11 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:12.090125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:12.091048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:12.100293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.101004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.102194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.102851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.401923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.410343 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d808402c-ce96-4462-809f-27c78d14a8a3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1509 microversion: 2.1 time: 0.324508 May 18 01:41:12.422863 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 253/475] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:12 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:12.423177 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.423301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:12.423301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:12.423474 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f527d734-ef98-437e-9d6a-702f14b5e9d1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1514 microversion: 2.1 time: 0.385804 May 18 01:41:12.423563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.423727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 223/476] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:12 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:12.424340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.424832 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:12.425261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:12.628434 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:12.637177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fe5a3c39-f1ab-49a3-bd8b-cc180a15a569 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.225190 May 18 01:41:12.637743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 254/477] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:12 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:13.094494 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:13.095122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:13.103082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.103532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.104339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.104774 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.309471 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:13.318214 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:13.319717 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:13.321469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a65bcb83-1804-42bb-a09c-c0003e4d1080 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.230763 May 18 01:41:13.321957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 224/478] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:13 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:13.440275 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:13.440922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:13.449056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.449510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.450285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.450720 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.641467 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:13.650164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-33bd10ee-8b5c-402e-bb37-f6f51ec984ac tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1514 microversion: 2.1 time: 0.213558 May 18 01:41:13.650730 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 255/479] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:13 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:13.654554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:13.655170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:13.662409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.662861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.663632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:13.664072 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:13.915133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:13.923835 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ad720775-24a9-4e84-8ffd-4ec68b0d81e8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.273563 May 18 01:41:13.924558 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 225/480] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:13 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:14.340222 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:14.340864 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:14.348019 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.348538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:14.349327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.349757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:14.543788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:14.552512 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:14.554033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:14.555193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-07aa6556-82ae-4c57-8d6c-6198c9e03586 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.218784 May 18 01:41:14.555749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 256/481] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:14 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:14.669754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:14.670386 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:14.680618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.681067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:14.681925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.682362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:14.876401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:14.885541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-69d50aa0-8308-4fad-86e0-3017966fdd70 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1514 microversion: 2.1 time: 0.221354 May 18 01:41:14.886117 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 226/482] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:14 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:14.941370 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:14.941986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:14.950002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.950457 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:14.951234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:14.951673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:15.287678 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:15.296634 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-708a39b8-bc4c-47a9-a7a3-6ff130b88c4e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.358989 May 18 01:41:15.297206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 257/483] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:14 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:15.574177 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:15.574786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:15.582031 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:15.582486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:15.583257 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:15.583692 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:15.792762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:15.801436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:15.802965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:15.804097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9fffc0a5-103a-4b5c-a589-7c26372fd800 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.234655 May 18 01:41:15.805339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 227/484] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:15 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:15.902838 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:15.903583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:15.911538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:15.912058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:15.913276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:15.914372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.297819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:16.306773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f9e240a5-ca08-4417-b478-6944f8f81381 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1514 microversion: 2.1 time: 0.408254 May 18 01:41:16.307647 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 258/485] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:15 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:16.315208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:16.316148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:16.325868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.326328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.327123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.327560 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.691339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:16.701035 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4d772c5c-71ba-47a9-a3c6-75279c5d6740 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.390153 May 18 01:41:16.701608 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 228/486] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:16 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:16.760601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:16.761212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:16.770279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.770810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.771595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.772020 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.823782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:16.824445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:16.832015 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.832730 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.833701 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:16.834135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:16.841822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:16.980627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7a21225e-ebb5-40d0-a400-24329cc03623 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 204 len: 0 microversion: 2.1 time: 0.224624 May 18 01:41:16.987997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 259/487] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:16 2021] DELETE /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:41:16.997549 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-67c0cf20-f93b-467d-bd18-8f0b8a6b0173 req-cbdbce72-8747-49e7-a20b-f433dfae9f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62020e0b-e4eb-4768-bd36-06357c7c3817", "name": "network-vif-deleted", "tag": "fcacad8c-00a8-4188-8908-a78179aa3614"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:16.999432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:16.999432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:17.010597 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-67c0cf20-f93b-467d-bd18-8f0b8a6b0173 req-cbdbce72-8747-49e7-a20b-f433dfae9f4c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.011056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-67c0cf20-f93b-467d-bd18-8f0b8a6b0173 req-cbdbce72-8747-49e7-a20b-f433dfae9f4c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.028259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-67c0cf20-f93b-467d-bd18-8f0b8a6b0173 req-cbdbce72-8747-49e7-a20b-f433dfae9f4c service nova] Creating event network-vif-deleted:fcacad8c-00a8-4188-8908-a78179aa3614 for instance 62020e0b-e4eb-4768-bd36-06357c7c3817 on hv-cinder-78462 May 18 01:41:17.033137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-67c0cf20-f93b-467d-bd18-8f0b8a6b0173 req-cbdbce72-8747-49e7-a20b-f433dfae9f4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047188 May 18 01:41:17.033920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 260/488] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:17.039142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:17.039862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:17.048129 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.048669 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.049949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.049949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.132781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.141423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.142922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.144044 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3620b6bb-f956-4d64-87d3-6f257a722307 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1746 microversion: 2.20 time: 0.324891 May 18 01:41:17.144621 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 229/489] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:16 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1746 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:17.261547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.270241 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b44188a6-7019-4c33-83df-ffdac6bb1e37 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1508 microversion: 2.1 time: 0.235185 May 18 01:41:17.270807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 261/490] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:17 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:17.323053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:17.323667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:17.331821 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.332271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.333085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.333523 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.403689 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.404159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.404644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lazy-loading 'fault' on Instance uuid 62020e0b-e4eb-4768-bd36-06357c7c3817 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:41:17.534695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.544802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a4a43afc-7d30-4881-9473-0d0b3b7b5206 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 200 len: 1308 microversion: 2.1 time: 0.225483 May 18 01:41:17.545390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 230/491] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:17 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:17.720919 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:17.721572 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:17.732364 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.732829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.733889 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:17.734894 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:17.967138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:17.976997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-89dbdddb-2127-440a-9254-c6e31df415c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.261393 May 18 01:41:17.977559 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 262/492] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:17 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:18.164674 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.166148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:18.175810 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.176287 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.177113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.177771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.286875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.287667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:18.295104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.295825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.296685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.297188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.474339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:18.488144 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:18.490125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:18.491457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6f43a4d5-6c4c-4fe3-86a5-37fe09c14ead tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.332442 May 18 01:41:18.495205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 231/493] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:18 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:18.562450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:18.567209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.568194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 62020e0b-e4eb-4768-bd36-06357c7c3817] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:18.572986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ea0ee5de-ed24-4222-ae64-f8b22fc6e4e6 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1508 microversion: 2.1 time: 0.289880 May 18 01:41:18.573561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 263/494] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:18 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:18.583869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.584259 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.585482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.586024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.638930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Instance 62020e0b-e4eb-4768-bd36-06357c7c3817 could not be found. May 18 01:41:18.639558 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 404 to user: Instance 62020e0b-e4eb-4768-bd36-06357c7c3817 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:18.640438 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-92fa038d-0e03-4a4f-8883-80266cc16a31 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817" status: 404 len: 111 microversion: 2.1 time: 0.082569 May 18 01:41:18.642395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 232/495] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:18 2021] GET /compute/v2.1/servers/62020e0b-e4eb-4768-bd36-06357c7c3817 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 01:41:18.649531 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.650046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:18.658097 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.658557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.659362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.659807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.732953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:18.873137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-19d2c2fc-18e1-42fb-9dae-c5022ac8ab01 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 204 len: 0 microversion: 2.1 time: 0.227169 May 18 01:41:18.873952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 264/496] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:18 2021] DELETE /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:41:18.881762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.882563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:18.891585 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.893094 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.894088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:18.894687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:18.995676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:18.996515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:19.008779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.010022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:19.011173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.016590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:19.233562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:19.243252 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-24b47674-114c-41ed-ae27-77018a6f1cb3 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1514 microversion: 2.1 time: 0.364784 May 18 01:41:19.247462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 233/497] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:18 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:19.345164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:19.355503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0e8a2bc6-4932-4d14-b99a-5413d92effba tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.364365 May 18 01:41:19.356867 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 265/498] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:18 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:19.513107 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:19.514047 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:19.522781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.524279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:19.525893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.526667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:19.591470 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:19.592407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:19.606055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.611372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:19.615670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:19.615670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:20.007160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:20.021723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f57e9800-0c7e-41d5-b723-c34364e63aed tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1508 microversion: 2.1 time: 0.434546 May 18 01:41:20.022717 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:20.038013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 266/499] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:19 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:20.038594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:20.038594 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:20.042276 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-162e7874-89f5-417d-a8a4-fa48c80bc0f3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.533163 May 18 01:41:20.045129 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 234/500] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:19 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:20.266108 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:20.266743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:20.280790 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:20.282272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:20.283118 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:20.287534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:20.372993 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:20.374269 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:20.392352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:20.396214 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:20.401087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:20.403873 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:21.264701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:21.280076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-71eae881-aec0-4226-8402-55b4968a30d5 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1514 microversion: 2.1 time: 1.018426 May 18 01:41:21.284270 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 267/501] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:20 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1514 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:21.298124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-3cc333a1-1d0c-481e-a7c1-2a8d0eb7aee8 req-8e6750d1-2a05-4ab3-b033-dc4eadfca386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "name": "network-vif-plugged", "status": "completed", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:21.298883 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:21.309032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:21.309032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:21.319254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fc4b2cf4-8def-4f43-b6ce-850ed895b33e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.949829 May 18 01:41:21.324205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 235/502] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:20 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:21.331097 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3cc333a1-1d0c-481e-a7c1-2a8d0eb7aee8 req-8e6750d1-2a05-4ab3-b033-dc4eadfca386 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:21.339778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:21.340175 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-3cc333a1-1d0c-481e-a7c1-2a8d0eb7aee8 req-8e6750d1-2a05-4ab3-b033-dc4eadfca386 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:21.351848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:21.374194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:21.375715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:21.379220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:21.380533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:21.387128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-3cc333a1-1d0c-481e-a7c1-2a8d0eb7aee8 req-8e6750d1-2a05-4ab3-b033-dc4eadfca386 service nova] Creating event network-vif-plugged:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:41:21.400687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-3cc333a1-1d0c-481e-a7c1-2a8d0eb7aee8 req-8e6750d1-2a05-4ab3-b033-dc4eadfca386 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113762 May 18 01:41:21.404577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 268/503] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:21.420683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:21.426398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:21.443743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:21.443988 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:21.445785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:21.446449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.313654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:22.334677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:22.337603 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:22.339030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e73af3e4-fa03-4cde-a2f6-c4e425a1cb63 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.933042 May 18 01:41:22.350447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 269/504] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:21 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:22.357361 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-8e6b1b87-5234-4814-97c4-0fe0c408be86 req-b972f63c-60e4-48ce-a21b-b4b76f56daf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9", "name": "network-vif-deleted", "tag": "6c6c3bcf-49b7-40fe-b685-3821a3ea13b4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:22.359284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:22.359284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:22.371179 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-8e6b1b87-5234-4814-97c4-0fe0c408be86 req-b972f63c-60e4-48ce-a21b-b4b76f56daf7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.371960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-8e6b1b87-5234-4814-97c4-0fe0c408be86 req-b972f63c-60e4-48ce-a21b-b4b76f56daf7 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.381910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:22.397299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5852514c-7fb9-421d-9e30-207c4e16b521 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 200 len: 1508 microversion: 2.1 time: 1.071634 May 18 01:41:22.400161 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-8e6b1b87-5234-4814-97c4-0fe0c408be86 req-b972f63c-60e4-48ce-a21b-b4b76f56daf7 service nova] Creating event network-vif-deleted:6c6c3bcf-49b7-40fe-b685-3821a3ea13b4 for instance 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 on hv-cinder-78462 May 18 01:41:22.412133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 236/505] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:21 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 1508 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:22.416761 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-8e6b1b87-5234-4814-97c4-0fe0c408be86 req-b972f63c-60e4-48ce-a21b-b4b76f56daf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064093 May 18 01:41:22.417495 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-631229cf-c90e-4810-85f7-cab0d4781050 req-9d8ba4fb-8508-43e0-abc2-c974a1963cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32391b7b-257b-4f36-b726-4dfd3f0b288f", "name": "network-vif-deleted", "tag": "c43ac595-ec03-4b39-9f1d-20edb0cfd8cb"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:22.418307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 270/506] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:22.419332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:22.419332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:41:22.425152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:22.426267 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:22.436650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.437533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.438558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.439288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.441820 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-631229cf-c90e-4810-85f7-cab0d4781050 req-9d8ba4fb-8508-43e0-abc2-c974a1963cc5 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.442296 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-631229cf-c90e-4810-85f7-cab0d4781050 req-9d8ba4fb-8508-43e0-abc2-c974a1963cc5 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.511799 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-631229cf-c90e-4810-85f7-cab0d4781050 req-9d8ba4fb-8508-43e0-abc2-c974a1963cc5 service nova] Creating event network-vif-deleted:c43ac595-ec03-4b39-9f1d-20edb0cfd8cb for instance 32391b7b-257b-4f36-b726-4dfd3f0b288f on hv-cinder-78462 May 18 01:41:22.531047 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-631229cf-c90e-4810-85f7-cab0d4781050 req-9d8ba4fb-8508-43e0-abc2-c974a1963cc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121521 May 18 01:41:22.536074 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 237/507] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:22.582919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:22.584292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:22.625782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.625922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.626664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.627160 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.634153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:22.635175 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:22.635770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lazy-loading 'fault' on Instance uuid 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:41:22.857171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:22.877095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a392afd9-1bf1-4d0b-805e-0ee40b7bb2e1 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 200 len: 1307 microversion: 2.1 time: 0.457237 May 18 01:41:22.878490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 271/508] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:22 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:23.244612 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:23.255548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5d6b016c-5f36-4980-a7ca-c17c70424f35 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.718095 May 18 01:41:23.256271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 238/509] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:22 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:23.360207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:23.361605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:23.388963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.390022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.391544 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.392340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.421341 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:23.421957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: 32391b7b-257b-4f36-b726-4dfd3f0b288f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:23.436220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.436726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.437570 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.438046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.556237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] HTTP exception thrown: Instance 32391b7b-257b-4f36-b726-4dfd3f0b288f could not be found. May 18 01:41:23.556903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Returning 404 to user: Instance 32391b7b-257b-4f36-b726-4dfd3f0b288f could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:23.557760 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e3458389-4fe9-42a2-9eb3-0f6234f1f930 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f" status: 404 len: 111 microversion: 2.1 time: 0.140824 May 18 01:41:23.558633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 239/510] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:23 2021] GET /compute/v2.1/servers/32391b7b-257b-4f36-b726-4dfd3f0b288f => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:41:23.566306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:23.567080 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:23.578696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.579532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.580354 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.580959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.657619 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:23.773567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:23.785407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:23.787619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:23.789353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d33bf664-ceae-40ba-b7f0-12603dcf2ec7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.433659 May 18 01:41:23.790524 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 272/511] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:23 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:23.823573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-14901c47-203c-438b-99f7-98f687275225 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 204 len: 0 microversion: 2.1 time: 0.259929 May 18 01:41:23.824663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 240/512] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:23 2021] DELETE /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 01:41:23.832869 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:23.836267 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:23.857502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.858851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.860249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.861606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.896364 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:23.897415 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:23.908023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.909107 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.910125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:23.911069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:23.977423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Instance 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 could not be found. May 18 01:41:23.978469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 404 to user: Instance 15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:23.979655 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6e11bfe0-0d37-47d6-b420-b4fbfc590ffe tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9" status: 404 len: 111 microversion: 2.1 time: 0.087648 May 18 01:41:23.988286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 241/513] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:23 2021] GET /compute/v2.1/servers/15e5f6ed-c16a-468d-b759-e2f0f4ecb5b9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:41:24.255727 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:24.274089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-00ad9f99-6db5-454f-9015-fc53b668b42b tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.444485 May 18 01:41:24.275426 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:24.276283 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:24.279963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 273/514] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:23 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:24.306338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:24.310704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:24.314017 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:24.314691 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:24.809431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:24.810684 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:24.818453 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:24.819349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:24.820878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:24.821666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.003331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:25.016536 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7b55bafa-fb7e-4c68-a188-611a2728775f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.745860 May 18 01:41:25.017370 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 242/515] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:24 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:25.296135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:25.296782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:25.318916 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.324868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.331905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.332859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.500691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:25.518211 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:25.522012 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:25.528598 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fedc3407-4322-4e7a-9b36-f3f735ed46d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.724017 May 18 01:41:25.530707 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 274/516] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:24 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:25.544873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:25.545576 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:25.555233 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.555950 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.557089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.557821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.658228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:41:25.826893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3aed6e4a-6b8a-4f86-b294-35cfc1848c8b tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 204 len: 0 microversion: 2.1 time: 0.294535 May 18 01:41:25.828378 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 275/517] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:41:25 2021] DELETE /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:41:25.837935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:25.838678 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:25.847384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.847844 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.848681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:25.849138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:25.884651 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:25.894898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-691178f5-c994-493d-8890-e1f8f2f49c0e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.602384 May 18 01:41:25.899441 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 243/518] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:25 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:26.034737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:26.035436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:26.051553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.051938 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:26.052779 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.053228 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:26.343488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:26.361996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ef800334-f27a-48fb-a8fa-e36bb3bd034f tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1514 microversion: 2.1 time: 0.528237 May 18 01:41:26.375401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 276/519] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:25 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1514 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:26.558595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:26.566748 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:26.587472 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.587657 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:26.588380 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.597365 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:26.606835 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:26.631690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-107f16dd-6ac5-4510-977f-32b203ac81c8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.600367 May 18 01:41:26.635103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 244/520] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:26 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:26.913971 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:26.915079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:26.935460 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.939084 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:26.946298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:26.947114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:27.199779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:27.220044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:27.225068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:27.226592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-62b9ab9d-d79d-433f-8df4-e41e24e90619 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.681285 May 18 01:41:27.227372 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 277/521] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:26 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:27.388511 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:27.393905 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:27.479011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:27.479775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:27.481329 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:27.481974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:27.652398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:27.670697 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a120407e-92e6-489a-abca-37af6b33c17a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.761078 May 18 01:41:27.671618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 245/522] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:26 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:27.679965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:27.680543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:27.707589 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:27.711954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:27.719473 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:27.720848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:28.485729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:28.495170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cb6fb48a-cb45-4310-aaac-aeb9190d5d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1723 microversion: 2.1 time: 0.822494 May 18 01:41:28.497138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 246/523] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:27 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1723 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:28.504170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:28.505221 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:28.513902 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:28.514730 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:28.515737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:28.516417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:28.536741 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:28.552525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cdaa0b77-75b5-4d68-b3a7-170a546b37f8 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1514 microversion: 2.1 time: 1.169054 May 18 01:41:28.553385 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 278/524] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:27 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1514 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:28.687680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:28.688689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:28.699916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:28.704552 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:28.705621 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:28.706890 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:29.164936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:29.175902 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c0bf02c4-de21-4a34-bd82-23885e93188e tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.492720 May 18 01:41:29.185819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 279/525] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:28 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:29.479878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:29.491106 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:29.498979 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:29.500506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dacdfca0-9f48-4b54-af43-28d1c498c092 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 1.002050 May 18 01:41:29.504941 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 247/526] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:28 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:29.517301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:29.518109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:29.531783 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:29.534775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:29.536062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:29.537774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:29.574451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:29.575952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:29.597862 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:29.600194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:29.602148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:29.602851 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.051844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d547b6ec5747ac8cf1a52579144454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7818818dab5a4878b403e46b3fedf215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:30.066358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-78a4a87c-f0c7-4325-a09e-e4d69841ebb2 tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 200 len: 1514 microversion: 2.1 time: 0.496663 May 18 01:41:30.075398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 248/527] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:29 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:30.155702 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:30.171345 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c0807247-0988-45e8-a78c-b3dc022acfe3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1700 microversion: 2.1 time: 0.659330 May 18 01:41:30.186921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 280/528] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:29 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1700 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:30.196699 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:30.197322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:30.197453 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e565f961-53b8-4c4b-971c-1495f15df7f7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:30.210000 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.211017 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.211819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.212259 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.214822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e565f961-53b8-4c4b-971c-1495f15df7f7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.214822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e565f961-53b8-4c4b-971c-1495f15df7f7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.368607 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e565f961-53b8-4c4b-971c-1495f15df7f7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Going to try to start instance {{(pid=92949) start /opt/stack/nova/nova/compute/api.py:2602}} May 18 01:41:30.540896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e565f961-53b8-4c4b-971c-1495f15df7f7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 202 len: 0 microversion: 2.1 time: 0.348075 May 18 01:41:30.545212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 281/529] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:41:30 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:41:30.565519 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-258bcc1f-baec-4ba8-938f-0ab87f9ca933 req-411533a3-89c6-4938-a184-3f3f0999c970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc567ad-7718-4f93-bae3-96e991f7c33c", "name": "network-vif-deleted", "tag": "0ea980e2-a2f9-4752-8917-0f3f9d94d1d4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:30.567313 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:30.567313 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:30.604494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-258bcc1f-baec-4ba8-938f-0ab87f9ca933 req-411533a3-89c6-4938-a184-3f3f0999c970 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.612851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-258bcc1f-baec-4ba8-938f-0ab87f9ca933 req-411533a3-89c6-4938-a184-3f3f0999c970 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.658093 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:30.664615 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-258bcc1f-baec-4ba8-938f-0ab87f9ca933 req-411533a3-89c6-4938-a184-3f3f0999c970 service nova] Creating event network-vif-deleted:0ea980e2-a2f9-4752-8917-0f3f9d94d1d4 for instance ebc567ad-7718-4f93-bae3-96e991f7c33c on hv-cinder-78462 May 18 01:41:30.670274 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ba7c317c-5c06-4f85-9782-edf2aecfc09f tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1521 microversion: 2.1 time: 0.477822 May 18 01:41:30.670858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 249/530] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:30 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:30.682028 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:30.682653 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:30.685952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-258bcc1f-baec-4ba8-938f-0ab87f9ca933 req-411533a3-89c6-4938-a184-3f3f0999c970 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142859 May 18 01:41:30.686760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 282/531] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:30.703180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:30.703180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:30.715272 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.715784 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.717644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.718105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.728771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.731663 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:30.734635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:30.735127 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:31.412036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:31.425714 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:31.440949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d345b5d6-fb33-4059-9c33-788eefe387c3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1709 microversion: 2.1 time: 0.752793 May 18 01:41:31.444184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:31.445066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 283/532] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:30 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1709 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:31.449611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:31.455013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] [instance: ebc567ad-7718-4f93-bae3-96e991f7c33c] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:31.455137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:31.455385 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9d5ede2d-2a71-4d7a-b591-5654f547dadc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.783576 May 18 01:41:31.461926 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 250/533] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:30 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:31.475545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:31.477262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:31.480603 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:31.481379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:31.633332 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] HTTP exception thrown: Instance ebc567ad-7718-4f93-bae3-96e991f7c33c could not be found. May 18 01:41:31.634739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] Returning 404 to user: Instance ebc567ad-7718-4f93-bae3-96e991f7c33c could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:31.635773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b619d7d9-2c72-4e2b-b5eb-42c96996460e tempest-AttachVolumeNegativeTest-199633762 tempest-AttachVolumeNegativeTest-199633762-project] 10.222.0.16 "GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c" status: 404 len: 111 microversion: 2.1 time: 0.190027 May 18 01:41:31.647080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 284/534] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:31 2021] GET /compute/v2.1/servers/ebc567ad-7718-4f93-bae3-96e991f7c33c => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:41:31.686807 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:31.688014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:31.701680 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:31.702158 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:31.702853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:31.705493 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:32.464357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:32.464773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:32.475509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:32.477382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:32.478655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:32.479296 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:32.558114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47174dfb228a4e7d96b542f269e95b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c7e3b2369f4588a3674cde01fd7d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:32.600479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fe716366-5efe-4526-856c-b61b4a80c1b0 tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 200 len: 1479 microversion: 2.1 time: 0.911650 May 18 01:41:32.600479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 251/535] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:31 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 1479 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:32.614416 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:32.619212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:32.628802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:32.630159 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:32.631593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:32.632608 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.406086 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:33.426643 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2132f2c6-ade7-4743-8209-17ec97d8f8ee tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1709 microversion: 2.1 time: 0.966385 May 18 01:41:33.439338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 285/536] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:32 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1709 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:33.444958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-b7bdcfb5-7066-45d8-bbb0-992e9af78efb req-8599fcde-bbed-4cb6-903c-97a24c0896cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca767d8-1b78-4c0e-a024-8c965bbc81fb", "name": "network-vif-deleted", "tag": "42f7a08b-e471-42b5-9f5c-ffcdcbc27e39"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:33.446771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:33.446771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:41:33.456845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-b7bdcfb5-7066-45d8-bbb0-992e9af78efb req-8599fcde-bbed-4cb6-903c-97a24c0896cb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:33.457717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-b7bdcfb5-7066-45d8-bbb0-992e9af78efb req-8599fcde-bbed-4cb6-903c-97a24c0896cb service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.477253 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-b7bdcfb5-7066-45d8-bbb0-992e9af78efb req-8599fcde-bbed-4cb6-903c-97a24c0896cb service nova] Creating event network-vif-deleted:42f7a08b-e471-42b5-9f5c-ffcdcbc27e39 for instance dca767d8-1b78-4c0e-a024-8c965bbc81fb on hv-cinder-78462 May 18 01:41:33.484448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-b7bdcfb5-7066-45d8-bbb0-992e9af78efb req-8599fcde-bbed-4cb6-903c-97a24c0896cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042448 May 18 01:41:33.485359 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 286/537] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:33.492547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "516d92de-d0ba-4707-81d2-222782c53d9f", "device": "/dev/sdb"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:33.494936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:33.508795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:33.509510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.510551 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:33.511173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.523334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:33.533048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:33.534577 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:33.535724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8b6b8c5f-8d87-4e6a-ae99-b423d3491feb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.932391 May 18 01:41:33.536271 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 252/538] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:32 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:33.620738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:33.622077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] [instance: dca767d8-1b78-4c0e-a024-8c965bbc81fb] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:33.638860 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:33.639910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.640799 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:33.641245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:33.727153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] HTTP exception thrown: Instance dca767d8-1b78-4c0e-a024-8c965bbc81fb could not be found. May 18 01:41:33.727741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] Returning 404 to user: Instance dca767d8-1b78-4c0e-a024-8c965bbc81fb could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:33.729363 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-872c159c-f0a4-4800-91d8-b7d4342f826a tempest-ServerRescueNegativeTestJSON-1396293916 tempest-ServerRescueNegativeTestJSON-1396293916-project] 10.222.0.16 "GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb" status: 404 len: 111 microversion: 2.1 time: 0.116038 May 18 01:41:33.733698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 253/539] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:33 2021] GET /compute/v2.1/servers/dca767d8-1b78-4c0e-a024-8c965bbc81fb => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:41:34.266459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a9f8d9c2-ba3f-4d3d-a355-4fa82eef8172 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "POST /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778535 May 18 01:41:34.274732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 287/540] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:41:33 2021] POST /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:34.447268 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:34.448716 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:34.465804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:34.466270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:34.467079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:34.474018 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:34.554437 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:34.556062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:34.594760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:34.599975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:34.601160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:34.619752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:35.179511 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:35.197909 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:35.201423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:35.212286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-330a375e-40bc-4bc2-a6a3-5a76b6693dbf tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1713 microversion: 2.1 time: 0.769160 May 18 01:41:35.215061 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:35.216532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-af39b71a-99e5-4f97-9c7f-c2f24906a983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1741 microversion: 2.20 time: 0.666556 May 18 01:41:35.229628 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 254/541] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:41:34 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1713 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:41:35.230215 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 288/542] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:34 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1741 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:36.236984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:36.238169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:36.250873 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:36.251637 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:36.254456 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:36.255066 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:36.907332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:36.921769 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:36.926322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:36.928088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-44e3d0c5-b4a2-4190-af19-d0c4a331fe8c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1723 microversion: 2.20 time: 0.695054 May 18 01:41:36.939261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 255/543] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:36 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1723 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:37.949715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:37.950614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:37.978506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:37.979056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:37.982204 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:37.983935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:38.485204 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:38.501093 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:38.502947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:38.504408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ad47f1f2-3fc6-409c-a2b8-d3c881d2f3c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1723 microversion: 2.20 time: 0.561002 May 18 01:41:38.515411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 289/544] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:37 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:39.527373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:39.528583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:39.544917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:39.545679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:39.546831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:39.547789 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:40.144788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:40.177130 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:40.179455 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:40.181090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-975d3263-2584-4006-b0a8-d28d426b9509 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1726 microversion: 2.20 time: 0.658635 May 18 01:41:40.191007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 256/545] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:39 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1726 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:40.200189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6336a82-9a0a-41db-9a61-1a1657d5fb04"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:40.200809 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:40.215419 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:40.215884 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:40.216802 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:40.217249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:40.413869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-21723acd-a973-4c50-a07f-aad10a70cb00 req-2be3f4df-4db3-4adf-8764-35fe79421166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "name": "network-vif-unplugged", "status": "completed", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:40.419735 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:41:40.419735 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:41:40.474686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-21723acd-a973-4c50-a07f-aad10a70cb00 req-2be3f4df-4db3-4adf-8764-35fe79421166 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:40.475151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-21723acd-a973-4c50-a07f-aad10a70cb00 req-2be3f4df-4db3-4adf-8764-35fe79421166 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:40.505085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.compute.server_external_events [req-21723acd-a973-4c50-a07f-aad10a70cb00 req-2be3f4df-4db3-4adf-8764-35fe79421166 service nova] Unable to find a host for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3. Dropping event network-vif-unplugged {{(pid=92948) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 18 01:41:40.506241 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-21723acd-a973-4c50-a07f-aad10a70cb00 req-2be3f4df-4db3-4adf-8764-35fe79421166 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097963 May 18 01:41:40.507831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 257/546] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 01:41:41.246099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b8c1fc25-a489-4779-9770-3617b604d69c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.050792 May 18 01:41:41.250272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 290/547] 10.222.0.16 () {62 vars in 1364 bytes} [Tue May 18 01:41:40 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments => generated 188 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:41:41.523255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:41.523967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:41.541513 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:41.542060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:41.542913 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:41.543362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:42.099681 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d4c8e9d8-f088-4da5-8c1e-c1513b88ea69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action" status: 202 len: 0 microversion: 2.20 time: 0.581014 May 18 01:41:42.104378 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 258/548] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:41:41 2021] POST /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 01:41:42.109592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:42.113776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:42.145172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:42.149056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:42.150045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:42.155891 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:43.153177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:43.167644 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:43.169542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:43.170991 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0cfdb811-3b0e-4fa6-9534-950a65fc2b86 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1752 microversion: 2.20 time: 1.065313 May 18 01:41:43.172245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 291/549] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:42 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1752 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:44.191907 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:44.193618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:44.222172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:44.224220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:44.225173 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:44.227551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:44.659458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:44.676068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:44.680284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:44.684676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d759da83-0026-4f44-9fde-53d4aa5d4971 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1752 microversion: 2.20 time: 0.498572 May 18 01:41:44.687861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 259/550] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:44 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1752 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:45.707164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:45.707969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:45.729810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:45.730268 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:45.731071 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:45.731542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:46.346103 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:46.369529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:46.382262 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:46.387876 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3337aa77-3f4d-4e80-8a7d-5db88000826c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1754 microversion: 2.20 time: 0.685440 May 18 01:41:46.388817 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 292/551] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:45 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1754 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:46.744530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c4b69005-6505-4bb4-80e9-0095c7b7d3ae tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Action: 'create', calling method: .version_select at 0x7efcd8ec6820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2140466007", "metadata": {"Type": "work"}}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:47.049430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Action: 'create', calling method: .version_select at 0x7efcd96e6040>, body: {"keypair": {"name": "tempest-TestShelveInstance-927515522"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:41:47.093008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for project 26a3a93319a54320819f6f385f3682b7. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:41:47.103006 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for user 15c7fbb09ac043a6a6827e1885505577 and project 26a3a93319a54320819f6f385f3682b7. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:41:47.460728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for project 26a3a93319a54320819f6f385f3682b7. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:41:47.477288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for user 15c7fbb09ac043a6a6827e1885505577 and project 26a3a93319a54320819f6f385f3682b7. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:41:47.524825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9987f889-f321-4e8a-b980-1a48f621597f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.672057 May 18 01:41:47.529660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 293/552] 10.222.0.16 () {60 vars in 1158 bytes} [Tue May 18 01:41:46 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:41:47.560138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:47.561157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:47.593259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:47.598476 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:47.599722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:47.602066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:47.809072 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c4b69005-6505-4bb4-80e9-0095c7b7d3ae tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.280939 May 18 01:41:47.811405 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 260/553] 10.222.0.16 () {60 vars in 1156 bytes} [Tue May 18 01:41:46 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1286 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 01:41:47.827077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-958f9060-b8c4-4df2-bfeb-3bf95851d4c0 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd8cea310>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:48.097458 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:48.122667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:48.125124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:48.127568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1d6a1de5-9ddd-44d5-9a69-f2729c16591c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1754 microversion: 2.20 time: 0.596857 May 18 01:41:48.128152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 294/554] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:47 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1754 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:48.186572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-958f9060-b8c4-4df2-bfeb-3bf95851d4c0 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 200 len: 353 microversion: 2.1 time: 0.367626 May 18 01:41:48.187387 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 261/555] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:47 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 353 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:41:49.149600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:49.150980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:49.162595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:49.163750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:49.164690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:49.165379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:49.202475 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ea369540-45e7-443d-9b7a-72981955bbe0 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd8ceae50>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:49.332631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ea369540-45e7-443d-9b7a-72981955bbe0 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 200 len: 354 microversion: 2.1 time: 0.136549 May 18 01:41:49.341082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 262/556] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:49 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:49.346238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-add63003-500b-4d7e-a4a4-14076f3c4cd7 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd8cead30>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:49.529670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-add63003-500b-4d7e-a4a4-14076f3c4cd7 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 200 len: 354 microversion: 2.1 time: 0.186983 May 18 01:41:49.530244 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 263/557] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:49 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:49.544571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:49.555732 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4f5a7c20-8fd8-4a23-af38-df334f050480 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd8cea1f0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:49.568963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:49.571096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:49.579099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-777b9216-aa35-4702-b1fe-394239f45593 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.429556 May 18 01:41:49.579904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 295/558] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:49 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:49.703454 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4f5a7c20-8fd8-4a23-af38-df334f050480 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 202 len: 0 microversion: 2.1 time: 0.157179 May 18 01:41:49.704397 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 264/559] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:41:49 2021] DELETE /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:41:49.713154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-11a5f270-42c4-498d-8679-9625eec279b7 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcda146430>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:49.889437 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-11a5f270-42c4-498d-8679-9625eec279b7 tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 200 len: 353 microversion: 2.1 time: 0.181035 May 18 01:41:49.890255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 296/560] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:49 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:50.597717 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:50.598329 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:50.606344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:50.607045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:50.607945 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:50.608558 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:50.836781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:50.849738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:50.852247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:50.853529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f2a0a943-4bcc-4dc1-975b-7061f7e66f13 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.259451 May 18 01:41:50.854306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 265/561] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:50 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:50.903502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7eedbc9d-f607-4038-9109-1a5f5303f00a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd9422280>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:51.008281 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7eedbc9d-f607-4038-9109-1a5f5303f00a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 200 len: 353 microversion: 2.1 time: 0.108347 May 18 01:41:51.008885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 297/562] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:50 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:41:51.871535 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:51.872245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:51.900089 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:51.901039 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:51.904572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:51.905373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:52.024121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-606a733a-9a6d-406c-aece-84e2dfa0d85a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Calling method '.version_select at 0x7efcd9422d30>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:52.141389 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-606a733a-9a6d-406c-aece-84e2dfa0d85a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] HTTP exception thrown: Volume d1f6496b-c19d-4317-97c5-7d22a33cf07a could not be found. May 18 01:41:52.142625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-606a733a-9a6d-406c-aece-84e2dfa0d85a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] Returning 404 to user: Volume d1f6496b-c19d-4317-97c5-7d22a33cf07a could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:41:52.143822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-606a733a-9a6d-406c-aece-84e2dfa0d85a tempest-VolumesGetTestJSON-730046826 tempest-VolumesGetTestJSON-730046826-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a" status: 404 len: 109 microversion: 2.1 time: 0.126928 May 18 01:41:52.149687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 298/563] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:41:52 2021] GET /compute/v2.1/os-volumes/d1f6496b-c19d-4317-97c5-7d22a33cf07a => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 01:41:52.497494 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:52.508125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:52.509679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:52.517686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2c82c27d-ffc1-454e-b47c-579b60e30edc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.643519 May 18 01:41:52.518338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 266/564] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:51 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:53.539541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:53.540989 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:53.557503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:53.558110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:53.559096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:53.559618 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:53.933979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:53.951008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:53.958095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:53.959642 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c49e8541-4c64-426e-a3f7-4d7188352582 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.425697 May 18 01:41:53.966750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 299/565] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:53 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:54.986800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:54.988019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:54.997778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:54.998470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:54.999648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:55.000170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:55.370390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:55.382642 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:55.384393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:55.385777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-aa1dafe1-24a8-4c53-98a3-1f5817fa7dfd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.404473 May 18 01:41:55.386326 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 267/566] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:54 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:41:56.405775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:56.406894 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:56.426924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:56.430260 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:56.432858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:56.434094 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:56.781042 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:56.793123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:56.795043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:56.796499 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a083b01e-3831-4467-a275-39c2d2894bf5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.396274 May 18 01:41:56.797531 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 300/567] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:56 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:57.816596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:57.817917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:57.825961 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:57.826419 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:57.827208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:57.827649 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:58.077112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:58.095936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:58.103360 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:58.105193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dbe80367-72c2-4cbc-b85f-2717da457a0d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.292671 May 18 01:41:58.106011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 268/568] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:57 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:41:59.123152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:41:59.123921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:41:59.132556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:59.133017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:59.133824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:41:59.134255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:41:59.372997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:59.384250 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:59.387148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:41:59.388609 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b50f97c3-b49c-40e6-920d-f87ba3ce9456 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.269398 May 18 01:41:59.389691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 301/569] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:41:59 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:00.411593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:00.412458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:00.420352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:00.420817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:00.421598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:00.422027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:00.662104 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:00.672155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:00.673695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:00.674832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-267ad024-a20e-48da-b6b5-b3b1bea0d3e6 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.267982 May 18 01:42:00.675375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 269/570] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:00 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:42:01.693897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:01.694579 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:01.702010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:01.702472 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:01.703582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:01.704113 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:01.907086 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:01.918011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:01.922220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:01.923415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-0fe23262-edc3-4e10-8dee-ae2acd140c74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.233453 May 18 01:42:01.924160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 302/571] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:01 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:02.995091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:02.995963 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:03.003446 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:03.003900 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:03.004703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:03.005142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:03.308407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:03.323019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:03.325873 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:03.327811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4c63a64a-ae0b-4134-aa38-fa0bf68cd318 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.389054 May 18 01:42:03.339600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 270/572] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:02 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:03.619937 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:03.620732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:03.628938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:03.629394 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:03.630186 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:03.630623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:03.818476 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lazy-loading 'services' on Instance uuid 87ce5ffd-6939-4076-a83e-65d02e86f150 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:42:04.030099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4227ed96-2c9a-403e-a905-3025bef0e7d3 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150/os-volume_attachments/516d92de-d0ba-4707-81d2-222782c53d9f" status: 202 len: 0 microversion: 2.1 time: 0.420491 May 18 01:42:04.036084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 303/573] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:42:03 2021] DELETE /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150/os-volume_attachments/516d92de-d0ba-4707-81d2-222782c53d9f => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:42:04.346544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:04.347322 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:04.356277 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:04.356934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:04.357934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:04.358542 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:04.599461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:04.611605 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:04.613247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:04.614403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6ffe20ca-a834-43c3-851e-2da693453a07 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.272220 May 18 01:42:04.615083 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 271/574] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:04 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:05.633975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:05.634783 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:05.642869 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:05.643418 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:05.644216 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:05.644841 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:05.855327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:05.865625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:05.867556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:05.868797 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9c830c8f-0dbf-43d8-8065-ff691642638c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.239391 May 18 01:42:05.869558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 304/575] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:05 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:06.890827 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:06.892119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:06.903637 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:06.904587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:06.905679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:06.906354 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:07.247389 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:07.264736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:07.266265 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:07.270027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-97403dec-cdb8-4041-af87-94018fbc7a7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.384620 May 18 01:42:07.276652 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 272/576] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:06 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:42:08.290121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:08.290739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:08.298055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:08.298449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:08.299233 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:08.299678 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:08.521073 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:08.531393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:08.532961 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:08.534109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-eab0e073-9749-43ea-a1c1-e9e1c38e8236 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.248644 May 18 01:42:08.534706 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 305/577] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:08 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:09.555327 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:09.555948 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:09.563256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:09.563745 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:09.564582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:09.565021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:09.769118 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:09.783425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:09.784984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:09.786119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-15e685f7-d664-44bd-9a36-ca744193edd9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.235211 May 18 01:42:09.786801 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 273/578] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:09 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:09.855171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:09.855842 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:09.864194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:09.864930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:09.866214 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:09.866936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:09.931459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:42:10.053804 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-708a480b-0245-4d64-b7fb-3dde672db895 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 204 len: 0 microversion: 2.1 time: 0.202012 May 18 01:42:10.054546 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 306/579] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:42:09 2021] DELETE /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:42:10.062537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:10.063161 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:10.070698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:10.071043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:10.074539 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:10.074539 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:10.269400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:10.280163 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-006fef64-6102-408d-93d5-2c02d5e2a8f4 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1515 microversion: 2.1 time: 0.221330 May 18 01:42:10.280761 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 274/580] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:10 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:10.805426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:10.806192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:10.813465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:10.813921 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:10.814698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:10.815137 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:11.028384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:11.037667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:11.039199 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:11.040357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-71483381-4a66-4080-91d6-0c98f71cc059 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.240187 May 18 01:42:11.040977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 307/581] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:10 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:11.297544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:11.298069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:11.305278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:11.305737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:11.306775 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:11.307228 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:11.508469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:11.517019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b43f9d75-3c54-4833-815b-356fb8bb585e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1515 microversion: 2.1 time: 0.223272 May 18 01:42:11.517587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 275/582] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:11 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:12.058925 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:12.059540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:12.066812 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:12.067269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:12.068046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:12.069143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:12.277933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:12.288334 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:12.290240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:12.291658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-68c7887e-f014-4e70-8c72-effb449ed034 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.236464 May 18 01:42:12.292339 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 308/583] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:12 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:12.537882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:12.539131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:12.563958 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:12.564722 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:12.566915 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:12.569379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:12.670975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-f3177bee-b3c0-4c32-9157-162ab3df691e req-ebb4419b-24f5-405e-a3dd-21e32506031d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce5ffd-6939-4076-a83e-65d02e86f150", "name": "network-vif-deleted", "tag": "a362a6cf-27f8-4883-9ad3-52e416d7cef1"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:12.672820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:12.672820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:42:12.685733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-f3177bee-b3c0-4c32-9157-162ab3df691e req-ebb4419b-24f5-405e-a3dd-21e32506031d service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:12.686189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-f3177bee-b3c0-4c32-9157-162ab3df691e req-ebb4419b-24f5-405e-a3dd-21e32506031d service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:12.703944 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:12.713678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cb03b0f1-0883-41fd-9bb4-ec211c676dfa tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 200 len: 1473 microversion: 2.1 time: 0.182800 May 18 01:42:12.714438 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 276/584] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:12 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:12.729114 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-f3177bee-b3c0-4c32-9157-162ab3df691e req-ebb4419b-24f5-405e-a3dd-21e32506031d service nova] Creating event network-vif-deleted:a362a6cf-27f8-4883-9ad3-52e416d7cef1 for instance 87ce5ffd-6939-4076-a83e-65d02e86f150 on hv-cinder-78462 May 18 01:42:12.734635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-f3177bee-b3c0-4c32-9157-162ab3df691e req-ebb4419b-24f5-405e-a3dd-21e32506031d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068210 May 18 01:42:12.736646 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 309/585] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:42:13.310984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:13.311531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:13.319325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:13.319784 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:13.320598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:13.321043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:13.532727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:13.542768 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:13.544402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:13.545545 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5630146b-5b0a-4a42-8d69-58057b5e2653 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.238392 May 18 01:42:13.546102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 277/586] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:13 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:13.732408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:13.733224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 87ce5ffd-6939-4076-a83e-65d02e86f150] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:13.741534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:13.741916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:13.742721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:13.743166 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:13.792590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] HTTP exception thrown: Instance 87ce5ffd-6939-4076-a83e-65d02e86f150 could not be found. May 18 01:42:13.793206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Returning 404 to user: Instance 87ce5ffd-6939-4076-a83e-65d02e86f150 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:42:13.794061 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a60cd8a0-ab20-4165-b13f-4cff0df1d641 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150" status: 404 len: 111 microversion: 2.1 time: 0.065851 May 18 01:42:13.794776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 310/587] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:13 2021] GET /compute/v2.1/servers/87ce5ffd-6939-4076-a83e-65d02e86f150 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:42:13.907395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-674774866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-927515522", "security_groups": [{"name": "tempest-secgroup-smoke-1420598844"}], "networks": [{"uuid": "5787d5f7-5be7-43d9-a969-a69199319951"}], "block_device_mapping_v2": [{"uuid": "1070e5d7-36f3-4bdf-83c9-7c16ef147b88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:14.231648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] validate_networks() for [('5787d5f7-5be7-43d9-a969-a69199319951', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:42:14.565080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:14.565690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:14.573664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:14.574057 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:14.574831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:14.575273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:14.955504 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:42:14.955981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:42:14.956448 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:42:14.956867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:42:14.957316 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:42:14.964196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:14.966718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:14.967172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:14.968162 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:14.968793 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:14.973625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:14.976117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:14.977571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5b7fd3f4-bf8c-4ed9-ae24-27d5c2839de8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.416343 May 18 01:42:14.978368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 311/588] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:14 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:42:14.987572 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for project 26a3a93319a54320819f6f385f3682b7. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:42:14.992231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Getting quotas for user 15c7fbb09ac043a6a6827e1885505577 and project 26a3a93319a54320819f6f385f3682b7. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:42:15.089222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:42:15.091334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1070e5d7-36f3-4bdf-83c9-7c16ef147b88',volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:42:15.253706 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-343bbd95-dda2-49b4-a28a-04469707d1a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.350344 May 18 01:42:15.254344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 278/589] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:42:13 2021] POST /compute/v2.1/servers => generated 406 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:42:15.264576 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5f6db23c-7fa5-4890-80cb-e795f305f760 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:15.265200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5f6db23c-7fa5-4890-80cb-e795f305f760 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:15.335445 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5f6db23c-7fa5-4890-80cb-e795f305f760 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:15.345344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5f6db23c-7fa5-4890-80cb-e795f305f760 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1087 microversion: 2.1 time: 0.084461 May 18 01:42:15.345951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 312/590] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:15 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:15.998353 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:15.999305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:16.008432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:16.008884 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:16.009646 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:16.010081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:16.227580 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:16.239429 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:16.241425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:16.242548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-014bad10-6625-4fc7-ad54-3858d3da3a2b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.249355 May 18 01:42:16.243097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 279/591] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:15 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:16.362861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:16.364172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:16.373726 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:16.374477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:16.375351 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:16.375796 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:16.489707 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:16.497965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-824f6c72-1bb1-476a-a028-d8a13899cc93 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1137 microversion: 2.1 time: 0.138834 May 18 01:42:16.498764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 313/592] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:16 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1137 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:17.261948 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:17.262482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:17.270302 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.270797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.272354 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.273015 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.505818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:17.514878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:17.516094 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:17.517598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:17.519141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:17.520284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8095b154-9f29-4b78-b57c-1396aa5eaeb5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.262194 May 18 01:42:17.523929 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.524424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.525326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.525772 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.532888 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 280/593] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:17 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:17.538249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:17.538759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:17.546203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.546666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.547447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:17.547893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:17.677290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:17.686666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-182b5a2f-f0d3-4370-a44b-ac34b098ff18 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1185 microversion: 2.1 time: 0.175375 May 18 01:42:17.687570 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 314/594] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:17 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:17.748602 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lazy-loading 'services' on Instance uuid 5ba23ab8-adff-42c4-8703-96301fb86d53 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:42:17.947432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-bcdd231d-ec83-48d3-bcf0-cd41780fc4b4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-volume_attachments/1056c7d4-d30f-41aa-be50-0a6853d276bd" status: 202 len: 0 microversion: 2.1 time: 0.413164 May 18 01:42:17.948397 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 281/595] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:42:17 2021] DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/os-volume_attachments/1056c7d4-d30f-41aa-be50-0a6853d276bd => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:42:18.546220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:18.547637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:18.559084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:18.561152 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:18.562190 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:18.562836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:18.706714 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:18.708131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:18.720024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:18.720895 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:18.721979 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:18.722627 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:18.903939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:18.915044 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-32e093d9-628a-4f94-aa1e-7d7aa169a6e1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1203 microversion: 2.1 time: 0.215035 May 18 01:42:18.920971 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 282/596] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:18 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:19.154398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:19.166076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:19.168683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:19.170078 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e09ff45e-a092-4fed-89b4-2552e3af4ce7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.628416 May 18 01:42:19.184967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 315/597] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:18 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:19.624547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-fb7099c4-4169-404d-bf63-8acd1a58a43e req-30ac23b1-6a06-4e96-816a-6ce168e26927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "name": "network-vif-plugged", "status": "completed", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:19.626361 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:19.626361 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:42:19.635916 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-fb7099c4-4169-404d-bf63-8acd1a58a43e req-30ac23b1-6a06-4e96-816a-6ce168e26927 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:19.636489 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-fb7099c4-4169-404d-bf63-8acd1a58a43e req-30ac23b1-6a06-4e96-816a-6ce168e26927 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:19.663154 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-fb7099c4-4169-404d-bf63-8acd1a58a43e req-30ac23b1-6a06-4e96-816a-6ce168e26927 service nova] Creating event network-vif-plugged:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:42:19.682034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-fb7099c4-4169-404d-bf63-8acd1a58a43e req-30ac23b1-6a06-4e96-816a-6ce168e26927 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061644 May 18 01:42:19.683261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 283/598] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:42:19.937177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:19.937752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:19.951716 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:19.952504 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:19.953505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:19.954179 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.189632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:20.190383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:20.203052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.204701 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.205872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.206550 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.557910 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:20.567288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-66f0bfd7-5fd3-4643-9a6a-c5f6aaf1f683 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.633738 May 18 01:42:20.567886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 316/599] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:19 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:20.580201 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-52b2214a-dcbd-4ced-ae02-804f34e22817 req-3e76114f-c544-4a85-a46c-fdac2362af9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:20.584534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:20.584534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:42:20.593111 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-52b2214a-dcbd-4ced-ae02-804f34e22817 req-3e76114f-c544-4a85-a46c-fdac2362af9c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.593648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-52b2214a-dcbd-4ced-ae02-804f34e22817 req-3e76114f-c544-4a85-a46c-fdac2362af9c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.610381 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-52b2214a-dcbd-4ced-ae02-804f34e22817 req-3e76114f-c544-4a85-a46c-fdac2362af9c service nova] Creating event network-changed:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:42:20.616002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-52b2214a-dcbd-4ced-ae02-804f34e22817 req-3e76114f-c544-4a85-a46c-fdac2362af9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044807 May 18 01:42:20.617176 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 317/600] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:42:20.622640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-872036e3-fff0-4a43-b7a4-f74b6e9b2e43 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:20.632048 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-872036e3-fff0-4a43-b7a4-f74b6e9b2e43 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.633095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-872036e3-fff0-4a43-b7a4-f74b6e9b2e43 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.695036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-872036e3-fff0-4a43-b7a4-f74b6e9b2e43 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Going to try to stop instance {{(pid=92949) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 18 01:42:20.759231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:20.769661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:20.771571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:20.772937 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-962af558-989c-48d5-af22-aeaebe72c501 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.587761 May 18 01:42:20.773619 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 284/601] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:20 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:42:20.775425 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-872036e3-fff0-4a43-b7a4-f74b6e9b2e43 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 202 len: 0 microversion: 2.1 time: 0.157244 May 18 01:42:20.776023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 318/602] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:42:20 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:42:20.784128 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:20.784836 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:20.793688 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.794134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:20.794929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:20.795328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:21.006882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:21.015293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7f04e893-e167-4e40-b412-719cead083c6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.235263 May 18 01:42:21.015855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 285/603] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:20 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:21.586853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:21.587554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:21.594913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:21.595360 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:21.596128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:21.596595 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:21.792284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:21.792919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:21.800408 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:21.800864 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:21.801640 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:21.802077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:21.849715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:21.858163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-461ddf37-3107-4d60-873c-f12463ad31d1 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.276144 May 18 01:42:21.858902 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 319/604] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:21 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:22.009894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:22.018967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:22.020515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:22.021886 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fa33bf25-de25-4d51-ba0f-34c5626b630a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.233624 May 18 01:42:22.022716 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 286/605] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:21 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:42:22.032437 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:22.033063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:22.040451 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:22.040919 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:22.041705 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:22.042172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:22.336458 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:22.345238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-eab247af-2614-421f-ab34-98d5d71cfe9f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.316487 May 18 01:42:22.346450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 320/606] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:22 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:22.875183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:22.875809 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:22.884110 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:22.884727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:22.885767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:22.886350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:23.040742 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:23.042096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:23.051534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:23.052388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:23.054102 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:23.054748 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:23.150306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:23.160643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0711f2a7-dae2-4794-8cb0-5206963e7b2e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.289088 May 18 01:42:23.161420 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 287/607] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:22 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:23.366868 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:23.368026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:23.378007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:23.378813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:23.379848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:23.380563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:23.478468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:23.498960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:23.500521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:23.501679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6c6b6791-3dc5-4df8-b664-08fbcddcffa5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.465399 May 18 01:42:23.502253 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 321/608] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:23 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:23.623283 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:23.633179 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b417b9b8-15a1-47b2-84da-2c7e12f6fafd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.270867 May 18 01:42:23.633752 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 288/609] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:23 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:24.180107 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:24.181185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:24.189821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:24.190221 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:24.190996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:24.191432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:24.397008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:24.406267 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-94580e78-f431-4031-ab61-e1bed609af25 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.231836 May 18 01:42:24.407179 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 322/610] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:24 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:24.515770 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-162673074", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "networks": [{"uuid": "d65b85fd-08c9-43e8-8336-2db4b9430060"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:24.521724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:24.522591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:24.541505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:24.544171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:24.545011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:24.545448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:24.592955 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] validate_networks() for [('d65b85fd-08c9-43e8-8336-2db4b9430060', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:42:25.003172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.013350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.015156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.016556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ac28da0f-a241-470f-a079-3a357371893e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.498776 May 18 01:42:25.018290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 323/611] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:24 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:25.030680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:25.031563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:25.039904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.040396 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.041197 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.041647 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.261400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:42:25.261997 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:42:25.262677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:42:25.263095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:42:25.263691 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:42:25.274826 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.275448 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.276258 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.276720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.307337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Getting quotas for project d7a4c6597af74bf0998a3927c38e3b52. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:42:25.311861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Getting quotas for user b3a9ccca964e43f1b372795036241958 and project d7a4c6597af74bf0998a3927c38e3b52. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:42:25.327591 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:42:25.330033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.330783 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:42:25.339446 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-14161c40-8380-47a8-bc8a-4226fa6acaf4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.321074 May 18 01:42:25.343398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 324/612] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:25 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:25.387530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b28e7258-1ae5-4bea-b59e-ead8ea4da901 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875366 May 18 01:42:25.388645 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 289/613] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:42:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:42:25.399142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-56b09817-52b2-4a7f-bbe2-900658754b08 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:25.399766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-56b09817-52b2-4a7f-bbe2-900658754b08 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:25.422846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:25.423716 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:25.432709 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.434015 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.434389 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:25.435032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:25.495511 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-56b09817-52b2-4a7f-bbe2-900658754b08 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.503386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-56b09817-52b2-4a7f-bbe2-900658754b08 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1218 microversion: 2.1 time: 0.108965 May 18 01:42:25.504272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 325/614] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:25 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:25.637930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:25.646346 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4243888d-3ec7-43d2-ac07-94276c0ca6cb tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.227165 May 18 01:42:25.647139 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 290/615] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:25 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:26.035083 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:26.035760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:26.043697 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.044154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.044964 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.045403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.241075 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.250215 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.251742 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.252917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ab1223f1-007e-4380-920d-79d74e37001b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.221569 May 18 01:42:26.253476 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 326/616] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:26 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:26.359725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:26.360414 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:26.368232 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.368774 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.369554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.369989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.520701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:26.521814 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:26.529197 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.529652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.530433 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.530868 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.672975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.679110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.681912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-df2dce0c-a8d0-491f-b0e7-718bff8d57a7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.325875 May 18 01:42:26.682483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 291/617] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:26 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:26.686767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:26.687590 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-adfccd8c-83db-4e82-9a95-2bfb0850de39 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1222 microversion: 2.1 time: 0.170566 May 18 01:42:26.687726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:26.688439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 327/618] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:26 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:26.695633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.696076 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.696869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:26.697334 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:26.906729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:26.916372 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-645d2231-0b0d-4952-b638-c556da1f1ada tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.232828 May 18 01:42:26.917099 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 292/619] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:26 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:27.270965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:27.271862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:27.279165 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.279627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.280449 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.280897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.475809 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:27.484924 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:27.486431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:27.487555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f227f0f7-31b0-4d48-8694-ef756530218a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.220482 May 18 01:42:27.488118 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 328/620] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:27 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:27.699442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:27.700144 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:27.705183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:27.705800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:27.707320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.707956 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.709033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.709480 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.713500 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.713949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.714721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.715155 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.892077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:27.905876 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-744db5eb-ce73-4449-b767-fe4b4c899ba7 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1270 microversion: 2.1 time: 0.202404 May 18 01:42:27.908374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 329/621] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:27 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:27.933983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:27.934837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:27.942459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.942917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:27.944059 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:27.944491 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:28.036252 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:28.047458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c199ff0a-d7f0-44b4-b348-edfa1c864222 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.351997 May 18 01:42:28.048278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 293/622] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:27 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:28.307358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:28.315373 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1d26a178-7ca1-45a1-bcf5-aa282174f75b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.385229 May 18 01:42:28.315934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 330/623] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:27 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:28.507293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:28.507906 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:28.515125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:28.515579 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:28.516374 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:28.516811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:28.724007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:28.733316 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:28.734764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:28.736761 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f935a30e-591d-4757-9808-72766a7a07c8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.234165 May 18 01:42:28.737325 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 294/624] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:28 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:28.925055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:28.925660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:28.933638 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:28.934092 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:28.934858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:28.935292 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.047248 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.055906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-97357260-710c-4939-ac24-a14a0117828f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1270 microversion: 2.1 time: 0.134523 May 18 01:42:29.056509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 331/625] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:28 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:29.065062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:29.065668 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:29.073530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.073978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.074742 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.075175 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.279341 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.288081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9b77ea58-0dbf-4278-8efe-1e0a3334af0f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.226632 May 18 01:42:29.288855 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 295/626] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:29 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:29.332901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:29.333958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:29.342557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.343090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.343907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.345033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.548158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.558288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a4494488-b53d-4545-be1b-96c761c56e7c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.229084 May 18 01:42:29.558858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 332/627] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:29 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:29.754883 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:29.756778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:29.764557 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.765148 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.766133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:29.766576 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:29.973180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.983561 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.985124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:29.986268 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2e33cb92-2b9c-4f51-915b-357ee0c96efe tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1810 microversion: 2.20 time: 0.235289 May 18 01:42:29.986829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 296/628] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:29 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:30.072324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:30.072965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:30.080290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.080779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.081561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.082052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.191097 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:30.199327 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ed94b5f9-a905-4674-88b6-f86c0e400959 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1270 microversion: 2.1 time: 0.130671 May 18 01:42:30.199892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 333/629] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:30 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:30.305500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:30.306153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:30.313532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.314049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.314869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.315301 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.539320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:30.549275 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-aa67aa8e-847d-4d30-a516-7f4e8121309c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.247541 May 18 01:42:30.553151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 297/630] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:30 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:30.575754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:30.576416 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:30.584362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.584849 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.585686 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:30.586197 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:30.798880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:30.808521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fa882b0a-4b8a-4102-99b3-09573a8b6669 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.236965 May 18 01:42:30.809805 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 334/631] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:30 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:31.006639 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:31.007870 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:31.016477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.017245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.018247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.019045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.225693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:31.226509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:31.243223 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.243724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.246893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.247627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.262762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:31.278986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:31.280537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:31.281691 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d8af9d00-7b95-42ba-8f93-d8042a9c832d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1797 microversion: 2.20 time: 0.279562 May 18 01:42:31.285174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 298/632] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:42:31 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1797 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:42:31.385550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:31.394037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2f5edeea-b998-4bad-9edc-7c930cf6b843 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1276 microversion: 2.1 time: 0.181823 May 18 01:42:31.394878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 335/633] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:31 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:31.567281 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:31.568743 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:31.575719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.576266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.577153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.577670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.782885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:31.792551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-67a6d000-ccb5-438b-a1a0-ed27f6630aa8 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.229083 May 18 01:42:31.793318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 299/634] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:31 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:31.825465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:31.826099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:31.833282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.834282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:31.835487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:31.835934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:32.138660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:32.148178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b83cc944-6975-472b-902c-a2f7db2d5396 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.326265 May 18 01:42:32.149026 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 336/635] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:31 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:32.411802 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:32.413373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:32.422562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:32.423498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:32.424532 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:32.427496 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:32.740290 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:32.759295 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b4234a6a-2979-4b9e-b589-77b5e40ea396 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.344195 May 18 01:42:32.760152 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 300/636] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:32 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:32.767967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-ba756a55-eaf9-4b86-ac12-7b2fcf5147d5 req-c004c8ba-bb32-4e3a-9ad2-87a2a67df116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b3ae36-c27c-44eb-bb23-7ef7c7793c0f", "tag": "b2f2f2e0-8652-4629-bff7-4d95221cae28"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:32.769888 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:32.769888 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:42:32.789331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-ba756a55-eaf9-4b86-ac12-7b2fcf5147d5 req-c004c8ba-bb32-4e3a-9ad2-87a2a67df116 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:32.789722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-ba756a55-eaf9-4b86-ac12-7b2fcf5147d5 req-c004c8ba-bb32-4e3a-9ad2-87a2a67df116 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:32.809617 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:32.810303 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:32.812338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-ba756a55-eaf9-4b86-ac12-7b2fcf5147d5 req-c004c8ba-bb32-4e3a-9ad2-87a2a67df116 service nova] Creating event network-changed:b2f2f2e0-8652-4629-bff7-4d95221cae28 for instance 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f on hv-cinder-78462 May 18 01:42:32.819099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-ba756a55-eaf9-4b86-ac12-7b2fcf5147d5 req-c004c8ba-bb32-4e3a-9ad2-87a2a67df116 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058925 May 18 01:42:32.820290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 337/637] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:42:32.824871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:32.825529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:32.826549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:32.827151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:33.047273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:33.057481 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f6c447c4-ddd4-4503-b17c-7fe5a1bd2f6c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1677 microversion: 2.1 time: 0.251351 May 18 01:42:33.058324 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 301/638] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:32 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:33.166879 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:33.168625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:33.176428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:33.176972 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:33.178167 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:33.178878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:33.437886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:33.448078 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-82e8be63-1b6c-4389-8a67-c11bb24120a9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.286057 May 18 01:42:33.449148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 338/639] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:33 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:33.775431 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:33.776043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:33.783858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:33.784575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:33.785418 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:33.785916 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.010209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:34.022041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5dd38bf4-6a8d-4cd6-a8bf-277d1e611703 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.250779 May 18 01:42:34.023266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 302/640] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:33 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:34.076211 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:34.076864 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:34.095551 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.096002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.096820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.097259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.394012 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:34.403712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5904191a-8b16-4fbe-a87b-a02d10cd6641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1654 microversion: 2.1 time: 0.332213 May 18 01:42:34.404451 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 339/641] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:34 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1654 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:34.421671 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f8c5c96b-5ada-474d-9254-a4d2553bd881 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:34.429939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8c5c96b-5ada-474d-9254-a4d2553bd881 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.430398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f8c5c96b-5ada-474d-9254-a4d2553bd881 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.466749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:34.467607 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:34.477715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.478584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.480062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.480736 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.505282 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f8c5c96b-5ada-474d-9254-a4d2553bd881 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Going to try to start instance {{(pid=92948) start /opt/stack/nova/nova/compute/api.py:2602}} May 18 01:42:34.617409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f8c5c96b-5ada-474d-9254-a4d2553bd881 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action" status: 202 len: 0 microversion: 2.1 time: 0.184968 May 18 01:42:34.628509 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 303/642] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:42:34 2021] POST /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:42:34.636063 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:34.638097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:34.649046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.650253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.651258 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:34.651879 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:34.788888 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:34.800335 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-af50ca1c-63a7-480b-a238-936ac3366748 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.337853 May 18 01:42:34.801951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 340/643] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:34 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:34.893726 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:34.903254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9a4e1cea-438b-45ad-8d8d-88e7d0f617b6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1663 microversion: 2.1 time: 0.272452 May 18 01:42:34.903919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 304/644] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:34 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:35.040366 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:35.042713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:35.051995 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.054227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.055273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.056061 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.268236 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:35.277740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6a0c5ccb-cfbe-4ed3-8a44-1eaf0dd29698 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.242526 May 18 01:42:35.278200 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 341/645] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:35 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:35.754662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-c2810163-2454-456c-94e1-38994e967dcb req-0880f4b7-b6a8-4552-9b45-6971baa12567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "name": "network-vif-plugged", "status": "completed", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:35.756498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:35.756498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:42:35.765530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c2810163-2454-456c-94e1-38994e967dcb req-0880f4b7-b6a8-4552-9b45-6971baa12567 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.766315 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-c2810163-2454-456c-94e1-38994e967dcb req-0880f4b7-b6a8-4552-9b45-6971baa12567 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.784270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-c2810163-2454-456c-94e1-38994e967dcb req-0880f4b7-b6a8-4552-9b45-6971baa12567 service nova] Creating event network-vif-plugged:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:42:35.789686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-c2810163-2454-456c-94e1-38994e967dcb req-0880f4b7-b6a8-4552-9b45-6971baa12567 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039304 May 18 01:42:35.790662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 305/646] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:42:35.827578 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:35.828580 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:35.843840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.844438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.845428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.846468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.923053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:35.928086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:35.951142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.952656 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:35.955169 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:35.955834 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:36.383741 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:36.398691 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5fc73e5f-17c0-4fae-ac3d-7d1c72bdcf94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1259 microversion: 2.1 time: 0.583221 May 18 01:42:36.399864 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 342/647] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:35 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1259 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:36.405154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:36.405862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:36.415481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:36.416026 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:36.417194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:36.417803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:36.426803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:36.436229 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-852f351d-1862-4053-933b-52fa5bf7640c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1663 microversion: 2.1 time: 0.517803 May 18 01:42:36.437007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 306/648] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:35 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1663 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:36.636928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:36.645692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bb500cb9-dd20-4dd9-bbc0-2fe1c04d53cd tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.244199 May 18 01:42:36.647610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 343/649] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:36 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:37.415432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:37.416771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:37.424648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.425408 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.426635 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.428876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.460112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:37.461478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:37.484513 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.485090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.485942 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.486392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.751771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:37.762546 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-36b5ceb5-d226-49c0-bf8b-f156253f89a4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1441 microversion: 2.1 time: 0.350245 May 18 01:42:37.763804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 307/650] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:37 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1441 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:37.774336 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:37.775523 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:37.785473 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.787879 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.789099 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.789665 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.830486 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:37.840503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e169d969-8a41-4d95-b395-6d9137966e99 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1667 microversion: 2.1 time: 0.389318 May 18 01:42:37.841326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 344/651] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:37 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1667 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:37.855895 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:37.856554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:37.863958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.864479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:37.866194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:37.866670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:38.081145 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:38.089740 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a66946ac-a92a-4f4e-b73e-20fa28c4c51e tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.324563 May 18 01:42:38.090307 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 308/652] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:37 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:38.094717 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-e157b890-a7dc-4ff7-821f-34834168e56f req-98fd426a-22aa-4535-8c73-7f4136f95a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3ae36-c27c-44eb-bb23-7ef7c7793c0f", "name": "network-vif-plugged", "status": "completed", "tag": "b2f2f2e0-8652-4629-bff7-4d95221cae28"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:38.096320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:38.096320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:42:38.104859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e157b890-a7dc-4ff7-821f-34834168e56f req-98fd426a-22aa-4535-8c73-7f4136f95a97 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:38.105311 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e157b890-a7dc-4ff7-821f-34834168e56f req-98fd426a-22aa-4535-8c73-7f4136f95a97 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:38.121521 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-e157b890-a7dc-4ff7-821f-34834168e56f req-98fd426a-22aa-4535-8c73-7f4136f95a97 service nova] Creating event network-vif-plugged:b2f2f2e0-8652-4629-bff7-4d95221cae28 for instance 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f on hv-cinder-78462 May 18 01:42:38.123122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:38.126319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-e157b890-a7dc-4ff7-821f-34834168e56f req-98fd426a-22aa-4535-8c73-7f4136f95a97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034855 May 18 01:42:38.126911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 309/653] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:42:38.132785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e085fbab-d1e3-4a6a-bfeb-c389641cfe94 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1441 microversion: 2.1 time: 0.290185 May 18 01:42:38.134005 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 345/654] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:37 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1441 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:39.107771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:39.108651 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:39.117435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:39.117981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:39.118877 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:39.119355 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:39.337878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:39.346218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c47c0f5f-13eb-4f9e-bd09-0f98c558f521 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.242781 May 18 01:42:39.346791 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 310/655] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:39 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:40.362826 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:40.363484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:40.371306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:40.371766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:40.372577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:40.373019 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:40.654210 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:40.663227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-17f5aa66-8ae3-4e14-8ec1-8285e5303378 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.303990 May 18 01:42:40.663812 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 346/656] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:40 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:40.729102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-1d36c186-a18e-42fb-b5d2-9dd17a2f1d85 req-57d837e7-829d-4fd1-b51f-25408b3f2d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:40.730357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:42:40.730357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:42:40.738558 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-1d36c186-a18e-42fb-b5d2-9dd17a2f1d85 req-57d837e7-829d-4fd1-b51f-25408b3f2d55 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:40.739004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-1d36c186-a18e-42fb-b5d2-9dd17a2f1d85 req-57d837e7-829d-4fd1-b51f-25408b3f2d55 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:40.755359 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-1d36c186-a18e-42fb-b5d2-9dd17a2f1d85 req-57d837e7-829d-4fd1-b51f-25408b3f2d55 service nova] Creating event network-changed:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:42:40.760762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-1d36c186-a18e-42fb-b5d2-9dd17a2f1d85 req-57d837e7-829d-4fd1-b51f-25408b3f2d55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037270 May 18 01:42:40.761355 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 311/657] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:42:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:42:41.683375 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:41.684274 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:41.691989 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:41.692589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:41.694213 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:41.694774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:42.131439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:42.143943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fd910d1b-61cb-49af-ac8c-6046c3c0fb5f tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1318 microversion: 2.1 time: 0.467218 May 18 01:42:42.144567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 347/658] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:41 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:42:43.162481 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:42:43.163192 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:43.171027 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:43.171479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:43.172288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:43.172762 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:43.382352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:42:43.390475 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-43929a62-3537-4056-b9b9-304eeba84a0c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1507 microversion: 2.1 time: 0.232829 May 18 01:42:43.391043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 312/659] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:42:43 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:42:43.407171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ca8aa65-971c-4441-ba9a-9330039594be", "device": "/dev/sdb"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:42:43.408414 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:42:43.416983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:43.417447 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:43.418232 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:42:43.418674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:42:43.803171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1171fa9d-0312-4d56-b977-eb7bceec0d38 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "POST /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398845 May 18 01:42:43.803885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 348/660] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:42:43 2021] POST /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:04.221750 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:04.222327 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:04.230582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:04.231040 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:04.231821 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:04.232263 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:04.401319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lazy-loading 'services' on Instance uuid 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:43:04.545819 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4e005df3-88ef-474e-9cc2-d71c4aad52f9 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f/os-volume_attachments/6ca8aa65-971c-4441-ba9a-9330039594be" status: 202 len: 0 microversion: 2.1 time: 0.327765 May 18 01:43:04.546525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 313/661] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:43:04 2021] DELETE /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f/os-volume_attachments/6ca8aa65-971c-4441-ba9a-9330039594be => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:43:06.854452 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:06.855040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:06.863630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:06.864096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:06.864947 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:06.865487 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:06.933782 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:43:07.044742 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-dde8f5a4-c33f-48fe-9170-20038f2fdff0 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 204 len: 0 microversion: 2.1 time: 0.194687 May 18 01:43:07.045317 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 349/662] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:43:06 2021] DELETE /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:43:07.055498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:07.056386 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:07.065085 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:07.065549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:07.066337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:07.066773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:07.272197 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:07.280553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-92b77ffe-221a-4ab9-a3fd-69d93efbfd04 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1513 microversion: 2.1 time: 0.230709 May 18 01:43:07.281127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 314/663] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:07 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:08.298667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:08.299375 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:08.306565 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:08.307017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:08.307800 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:08.308244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:08.510188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:08.518584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ad077107-46d2-41a0-ae80-a70c72b7bd19 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1513 microversion: 2.1 time: 0.224082 May 18 01:43:08.519156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 350/664] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:08 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:09.536230 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:09.537038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:09.549629 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:09.550171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:09.551163 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:09.551759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:09.942321 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a9ccca964e43f1b372795036241958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a4c6597af74bf0998a3927c38e3b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:09.955729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-788d4370-10e8-4910-b169-02e2caefd140 tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 200 len: 1513 microversion: 2.1 time: 0.423441 May 18 01:43:09.956727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 315/665] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:09 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:43:10.114222 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-ff894d87-31ce-4274-8674-43cab316083a req-fba3993e-1a10-4646-8b16-da77b005f53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3ae36-c27c-44eb-bb23-7ef7c7793c0f", "name": "network-vif-deleted", "tag": "b2f2f2e0-8652-4629-bff7-4d95221cae28"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:10.116689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:10.116689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:10.125555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-ff894d87-31ce-4274-8674-43cab316083a req-fba3993e-1a10-4646-8b16-da77b005f53a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:10.126479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-ff894d87-31ce-4274-8674-43cab316083a req-fba3993e-1a10-4646-8b16-da77b005f53a service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:10.148201 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-ff894d87-31ce-4274-8674-43cab316083a req-fba3993e-1a10-4646-8b16-da77b005f53a service nova] Creating event network-vif-deleted:b2f2f2e0-8652-4629-bff7-4d95221cae28 for instance 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f on hv-cinder-78462 May 18 01:43:10.153014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-ff894d87-31ce-4274-8674-43cab316083a req-fba3993e-1a10-4646-8b16-da77b005f53a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042407 May 18 01:43:10.153683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 351/666] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:10.973974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:10.975953 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] [instance: 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:10.983647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:10.984102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:10.984919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:10.985362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:11.037952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] HTTP exception thrown: Instance 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f could not be found. May 18 01:43:11.038696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] Returning 404 to user: Instance 69b3ae36-c27c-44eb-bb23-7ef7c7793c0f could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:43:11.039598 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b64a5f69-7644-4743-af07-e37b5dcec21c tempest-VolumesSnapshotTestJSON-1673903018 tempest-VolumesSnapshotTestJSON-1673903018-project] 10.222.0.16 "GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f" status: 404 len: 111 microversion: 2.1 time: 0.069318 May 18 01:43:11.040151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 316/667] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:10 2021] GET /compute/v2.1/servers/69b3ae36-c27c-44eb-bb23-7ef7c7793c0f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:43:19.634774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:19.635319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:19.642986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:19.643441 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:19.644217 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:19.644697 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:19.708993 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e9f36733-6424-485c-8c0e-08e827360c5a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments/b6336a82-9a0a-41db-9a61-1a1657d5fb04" status: 200 len: 194 microversion: 2.20 time: 0.079262 May 18 01:43:19.714827 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 352/668] 10.222.0.16 () {60 vars in 1454 bytes} [Tue May 18 01:43:19 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments/b6336a82-9a0a-41db-9a61-1a1657d5fb04 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:43:19.823847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:19.824434 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:19.831415 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:19.832060 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:19.832854 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:19.833288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:19.994993 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lazy-loading 'services' on Instance uuid 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:43:20.136375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0ed5e51f-84c4-47e7-8754-cc36ff62940e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments/b6336a82-9a0a-41db-9a61-1a1657d5fb04" status: 202 len: 0 microversion: 2.20 time: 0.316161 May 18 01:43:20.136971 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 317/669] 10.222.0.16 () {60 vars in 1457 bytes} [Tue May 18 01:43:19 2021] DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3/os-volume_attachments/b6336a82-9a0a-41db-9a61-1a1657d5fb04 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 01:43:22.439823 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:22.441049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:22.449633 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:22.450373 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:22.451495 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:22.452163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:22.516756 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:43:22.627237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8c1862d2-3542-4fbc-951c-5333c7c0e852 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 204 len: 0 microversion: 2.20 time: 0.191145 May 18 01:43:22.627824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 353/670] 10.222.0.16 () {60 vars in 1280 bytes} [Tue May 18 01:43:22 2021] DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 01:43:22.636981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:22.637766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:22.641237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7960fc8c-6c4d-4497-8e73-309bb2ac4fbc] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 18 01:43:22.646465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:22.646899 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:22.647686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:22.648121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:22.853656 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:22.862285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:22.863899 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:22.865082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-bfc52b0b-40e7-47dc-848d-32ef274fbc18 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.232319 May 18 01:43:22.866432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 318/671] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:22 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:23.888589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:23.889288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:23.896740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:23.897198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:23.898112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:23.898558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:24.383357 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:24.392022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:24.393604 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:24.394753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e9954d56-83b4-41d1-9c4e-b29f26fd5ac0 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1725 microversion: 2.20 time: 0.510475 May 18 01:43:24.395312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 354/672] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:23 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1725 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:43:25.414670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:25.415390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:25.435973 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:25.436547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:25.437338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:25.437777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:25.473503 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] [7960fc8c-6c4d-4497-8e73-309bb2ac4fbc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46350. May 18 01:43:25.662676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:25.672215 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:25.673766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:25.674923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-260120bc-8291-45bd-91c8-1dc7e57677a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1657 microversion: 2.20 time: 0.265440 May 18 01:43:25.675520 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 319/673] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:25 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1657 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:25.861681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-575680cd-7927-4396-96b9-65009ed92cec req-9ed01685-908b-4311-a6a2-2209877a7410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3", "name": "network-vif-deleted", "tag": "9626d5bd-0c0c-4981-894f-a4f285d15de8"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:25.863766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:25.863766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:25.875016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-575680cd-7927-4396-96b9-65009ed92cec req-9ed01685-908b-4311-a6a2-2209877a7410 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:25.875718 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-575680cd-7927-4396-96b9-65009ed92cec req-9ed01685-908b-4311-a6a2-2209877a7410 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:25.893885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-575680cd-7927-4396-96b9-65009ed92cec req-9ed01685-908b-4311-a6a2-2209877a7410 service nova] Creating event network-vif-deleted:9626d5bd-0c0c-4981-894f-a4f285d15de8 for instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 on hv-cinder-78462 May 18 01:43:25.898645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-575680cd-7927-4396-96b9-65009ed92cec req-9ed01685-908b-4311-a6a2-2209877a7410 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043428 May 18 01:43:25.899429 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 355/674] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:26.320038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:43:26.320574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: Tue May 18 01:43:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:43:26.693114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:26.694457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:26.702046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:26.702622 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:26.703476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:26.703996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:26.846667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:26.859050 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:26.860579 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:26.861917 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d00d447b-dd77-4fbf-bd0d-bce43a83f83d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1657 microversion: 2.20 time: 0.172685 May 18 01:43:26.862643 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 320/675] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:26 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1657 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:27.882412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:27.883136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:27.891715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:27.892174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:27.893012 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:27.893474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:28.006290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:28.014818 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:28.016382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:28.017512 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f351dab2-b676-47b5-8394-103cb407f99f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 200 len: 1366 microversion: 2.20 time: 0.140195 May 18 01:43:28.018065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 356/676] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:27 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:29.035976 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:29.036608 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:29.044402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:29.044853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:29.045615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:29.046053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:29.099032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. May 18 01:43:29.099663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:43:29.100754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d110d1e7-fb84-47e7-b3a7-cde3bbbbaa89 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 404 len: 111 microversion: 2.20 time: 0.068427 May 18 01:43:29.101306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 321/677] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:29 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 01:43:29.109655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-14d561a5-6a37-455b-a651-638b95630c34 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '.version_select at 0x7efcd95d40d0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:29.127226 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-14d561a5-6a37-455b-a651-638b95630c34 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090464693" status: 204 len: 0 microversion: 2.20 time: 0.021166 May 18 01:43:29.127773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 357/678] 10.222.0.16 () {60 vars in 1262 bytes} [Tue May 18 01:43:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090464693 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 01:43:30.122335 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: .version_select at 0x7efcd8fda160>, body: {"keypair": {"name": "tempest-keypair-852095402"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:30.144514 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:30.148925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:30.160199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [51001995-8d97-4bbc-b863-089d3568cf51] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 18 01:43:31.176451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [51001995-8d97-4bbc-b863-089d3568cf51] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46412. May 18 01:43:31.515423 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:31.519123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:31.532011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cbff869f-6ce6-4122-8bb0-cf5f989edd7e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.413455 May 18 01:43:31.532650 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 322/679] 10.222.0.16 () {62 vars in 1199 bytes} [Tue May 18 01:43:30 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1415 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 18 01:43:33.324529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381630230", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9a4e49a-e6eb-464d-8878-0bb9422087bd"}], "security_groups": [{"name": "tempest-securitygroup--1491518100"}], "key_name": "tempest-keypair-852095402", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:33.452673 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] validate_networks() for [('f9a4e49a-e6eb-464d-8878-0bb9422087bd', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:43:34.021212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:43:34.022721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:43:34.023212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:43:34.023630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:43:34.024051 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:43:34.032342 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:34.032806 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:34.033617 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:34.034056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:34.052085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:34.056612 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Getting quotas for user 7d2014d2cedb4d80a7586413365c2a1b and project e27a135b6f60458080f4d5d86c5f22b4. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:34.066987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:43:34.069859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:43:34.124066 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5fff93c2-0d3e-4edf-9be4-e75d9c0502a1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.803668 May 18 01:43:34.124750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 358/680] 10.222.0.16 () {62 vars in 1188 bytes} [Tue May 18 01:43:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 01:43:34.135435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:34.136065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:34.215194 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:34.223245 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:34.225452 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:34.226450 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fa740893-98eb-424c-80c3-bdfaa5875694 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1281 microversion: 2.20 time: 0.095670 May 18 01:43:34.236328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 323/681] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:34 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:35.245958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:35.246580 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:35.254148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:35.254652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:35.255462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:35.257295 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:35.497038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:35.512393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:35.514146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:35.515322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-63ca4436-9f47-4c24-b6ba-2313b94b0d69 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1333 microversion: 2.20 time: 0.273839 May 18 01:43:35.516430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 359/682] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:35 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1333 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:36.534299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:36.534931 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:36.545183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:36.545644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:36.546449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:36.546893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:36.990776 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:37.004231 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:37.007021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:37.008320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7645d604-6233-4ca0-b179-4b843f05f24e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.477946 May 18 01:43:37.012339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 324/683] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:36 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:37.697651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-afe9b0cb-105c-480b-8d07-07c6d5c86079 req-9e76d886-deed-48af-8688-1a936d546516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:37.699156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:37.699156 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:37.708121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-afe9b0cb-105c-480b-8d07-07c6d5c86079 req-9e76d886-deed-48af-8688-1a936d546516 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:37.709797 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-afe9b0cb-105c-480b-8d07-07c6d5c86079 req-9e76d886-deed-48af-8688-1a936d546516 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:37.729147 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-afe9b0cb-105c-480b-8d07-07c6d5c86079 req-9e76d886-deed-48af-8688-1a936d546516 service nova] Creating event network-changed:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:43:37.733996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-afe9b0cb-105c-480b-8d07-07c6d5c86079 req-9e76d886-deed-48af-8688-1a936d546516 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042567 May 18 01:43:37.734853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 360/684] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:43:38.026619 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:38.027863 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:38.036403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:38.037112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:38.038088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:38.038692 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:38.451057 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:38.465999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:38.467818 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:38.469285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a4476e19-4cdf-4442-958d-d49bf284debf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.446324 May 18 01:43:38.480667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 325/685] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:38 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:39.487226 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:39.487930 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:39.495758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:39.496218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:39.497084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:39.497529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:39.780045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:39.788763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:39.790293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:39.791390 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-98578900-e637-43c5-9ac5-dfb325b4192e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.308335 May 18 01:43:39.791951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 361/686] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:39 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:40.809346 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:40.810010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:40.818664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:40.818664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:40.819095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:40.819550 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:41.022634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:41.031930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:41.033482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:41.034573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-71dadc7d-ad26-4985-8ca4-c7ebfe3fec14 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.229037 May 18 01:43:41.035139 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 326/687] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:40 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:42.052086 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:42.053459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:42.060753 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:42.061202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:42.061972 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:42.062406 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:42.256775 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:42.265320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:42.266917 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:42.268075 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3b8b1b5b-f211-4db7-8f05-3aebfe006323 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.219833 May 18 01:43:42.268713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 362/688] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:42 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:43.286697 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:43.288161 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:43.296501 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.296959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.297766 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.298234 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.369681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:43.370235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:43.377546 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.378009 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.378908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.379356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.444851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:43:43.499132 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:43.509065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:43.510581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:43.511666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fc473f89-61d1-47cb-94fc-5b4e4eb7fc09 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.229249 May 18 01:43:43.512223 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 327/689] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:43 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:43.554121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bb4660ca-5dd6-427b-b598-8e3df1f203dd tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 204 len: 0 microversion: 2.1 time: 0.187922 May 18 01:43:43.554692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 363/690] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:43:43 2021] DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 01:43:43.562778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:43.563401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:43.571407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.571866 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.572832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:43.573277 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:43.767054 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:43.775442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-45a8d879-85c2-445d-a4a3-f562cb918259 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1673 microversion: 2.1 time: 0.216334 May 18 01:43:43.776003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 328/691] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:43 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:44.531040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:44.531664 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:44.539427 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:44.539881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:44.540693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:44.541138 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:44.743795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:44.752435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:44.753948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:44.755019 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ab9f8174-831c-497b-88e1-60653f52df1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.228393 May 18 01:43:44.755571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 364/692] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:44 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:44.793942 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:44.794490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:44.801644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:44.802101 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:44.802871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:44.803307 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:45.010286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:45.018528 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3180c8f2-0067-41b7-a984-1fa31b203641 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1673 microversion: 2.1 time: 0.228317 May 18 01:43:45.019097 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 329/693] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:44 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:45.144411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-be4f71f7-5012-4f74-8edf-83323ed53500 req-d10cf623-096b-449f-ad19-ff90f3d9f1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "name": "network-vif-plugged", "status": "completed", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:45.146349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:45.146349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:45.155488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-be4f71f7-5012-4f74-8edf-83323ed53500 req-d10cf623-096b-449f-ad19-ff90f3d9f1c3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:45.155944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-be4f71f7-5012-4f74-8edf-83323ed53500 req-d10cf623-096b-449f-ad19-ff90f3d9f1c3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:45.171901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-be4f71f7-5012-4f74-8edf-83323ed53500 req-d10cf623-096b-449f-ad19-ff90f3d9f1c3 service nova] Creating event network-vif-plugged:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:43:45.176494 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-be4f71f7-5012-4f74-8edf-83323ed53500 req-d10cf623-096b-449f-ad19-ff90f3d9f1c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035678 May 18 01:43:45.177084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 365/694] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:45.975587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:45.976516 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:45.984746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:45.985397 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:45.986326 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:45.986773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:46.035944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:46.036825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:46.045401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:46.046764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:46.047834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:46.048560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:46.651601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:46.662659 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:46.667658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:46.670828 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:46.672252 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-53b87479-74d6-40ab-ac8c-c1753d64d927 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1673 microversion: 2.1 time: 0.640358 May 18 01:43:46.672734 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2221449b-216d-4274-852d-145b6407d12b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1407 microversion: 2.20 time: 0.903535 May 18 01:43:46.684840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 366/695] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:46 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1673 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:43:46.686032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 330/696] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:45 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1407 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:43:47.353906 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-0df261e5-5723-41f8-a385-4c4bf1285ec2 req-2003c5b2-39e4-4e6d-8b8d-105fc7607c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba23ab8-adff-42c4-8703-96301fb86d53", "name": "network-vif-deleted", "tag": "ff49e2eb-02d8-42cc-a8ed-70c00ecf8204"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:47.356126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:47.356126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:47.375878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-0df261e5-5723-41f8-a385-4c4bf1285ec2 req-2003c5b2-39e4-4e6d-8b8d-105fc7607c84 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.376822 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-0df261e5-5723-41f8-a385-4c4bf1285ec2 req-2003c5b2-39e4-4e6d-8b8d-105fc7607c84 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.431829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-0df261e5-5723-41f8-a385-4c4bf1285ec2 req-2003c5b2-39e4-4e6d-8b8d-105fc7607c84 service nova] Creating event network-vif-deleted:ff49e2eb-02d8-42cc-a8ed-70c00ecf8204 for instance 5ba23ab8-adff-42c4-8703-96301fb86d53 on hv-cinder-78462 May 18 01:43:47.439039 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-0df261e5-5723-41f8-a385-4c4bf1285ec2 req-2003c5b2-39e4-4e6d-8b8d-105fc7607c84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090540 May 18 01:43:47.442038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 367/697] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:47.690768 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:47.691500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:47.700725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.701733 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.703014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.703681 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.709330 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:47.709330 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:47.716428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.717030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.717865 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.718315 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.800405 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:47.801265 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:47.801947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lazy-loading 'fault' on Instance uuid 5ba23ab8-adff-42c4-8703-96301fb86d53 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:43:47.983003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:47.997533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cfe9ee38-57d4-461d-a0c8-af2518ef8b76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 200 len: 1326 microversion: 2.1 time: 0.309680 May 18 01:43:47.999905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 331/698] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:47 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 1326 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:48.113560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:48.122768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:48.124316 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:48.125479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1356cf45-f852-4acb-9c68-819dd1ecc164 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1599 microversion: 2.20 time: 0.426533 May 18 01:43:48.126037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 368/699] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:43:47 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1599 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:43:48.143389 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:48.143808 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:48.153658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:48.154308 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:48.155477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:48.156445 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:48.339049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f2165b84-8fbd-4cfd-8017-8e3380b18c7c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.199413 May 18 01:43:48.339669 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 332/700] 10.222.0.16 () {60 vars in 1316 bytes} [Tue May 18 01:43:48 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:43:49.216777 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:49.217415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:49.226043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:49.226502 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:49.231591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:49.232144 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:49.296851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. May 18 01:43:49.297485 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:43:49.298408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-aae937d7-8163-48b9-ba09-173008e6d62a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 404 len: 111 microversion: 2.1 time: 0.284442 May 18 01:43:49.302552 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 369/701] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:49 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 111 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:43:49.307491 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0b8cdaa2-5cb0-4bd1-b858-64508aed97ec tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '.version_select at 0x7efcd8df74c0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:49.338866 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0b8cdaa2-5cb0-4bd1-b858-64508aed97ec tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51384957" status: 202 len: 0 microversion: 2.1 time: 0.035098 May 18 01:43:49.339453 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 333/702] 10.222.0.16 () {58 vars in 1215 bytes} [Tue May 18 01:43:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51384957 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:43:50.594393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-09a0f519-055a-400d-9aab-511dfb904c9a req-67ef7f00-2fc5-4862-bf46-508efd14947e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:50.595080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:50.595612 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:50.596280 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:50.596280 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:43:50.608801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:50.609289 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:50.610078 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:50.610700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:50.612102 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-09a0f519-055a-400d-9aab-511dfb904c9a req-67ef7f00-2fc5-4862-bf46-508efd14947e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:50.618398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-09a0f519-055a-400d-9aab-511dfb904c9a req-67ef7f00-2fc5-4862-bf46-508efd14947e service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:50.646402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-09a0f519-055a-400d-9aab-511dfb904c9a req-67ef7f00-2fc5-4862-bf46-508efd14947e service nova] Creating event network-changed:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:43:50.659084 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-09a0f519-055a-400d-9aab-511dfb904c9a req-67ef7f00-2fc5-4862-bf46-508efd14947e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067099 May 18 01:43:50.664711 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 334/703] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:43:50.766126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3b07ffe4-3f7f-42ae-8f99-759436e84ab9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.174100 May 18 01:43:50.767503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 370/704] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:50 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:51.718296 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: .version_select at 0x7efcda0918b0>, body: {"keypair": {"name": "tempest-keypair-743728704"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:51.745596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:51.749910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:51.779237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:51.780379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:51.794098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:51.796750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:51.797624 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:51.804826 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:51.898129 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:51.903038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:51.918903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2d3f75f7-a795-45f7-aa72-1c2dda582c95 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.204788 May 18 01:43:51.920293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 335/705] 10.222.0.16 () {60 vars in 1158 bytes} [Tue May 18 01:43:51 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:51.964205 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-aca20c7a-2b77-48ce-9dce-da19350df415 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.189420 May 18 01:43:51.965090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 371/706] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:51 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:52.978172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:52.979311 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:52.988049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:52.988540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:52.989331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:52.989771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:53.149923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-edcdd723-2404-4e40-ab89-52db0df3c519 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.178277 May 18 01:43:53.150570 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 336/707] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:52 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:54.166538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:54.168318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:54.182020 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:54.183087 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:54.184100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:54.185639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:54.312523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d0888a43-881a-40e9-b2fd-35f6ec42337c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.152192 May 18 01:43:54.313333 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 372/708] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:54 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:54.386884 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-480740046", "imageRef": "7447f8d8-1eae-4d22-823b-5150499ca118", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0329a854-a80f-4d3b-b599-428accfcaec5"}], "security_groups": [{"name": "tempest-securitygroup--1684987567"}], "key_name": "tempest-keypair-743728704", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:54.535191 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] validate_networks() for [('0329a854-a80f-4d3b-b599-428accfcaec5', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:43:55.289807 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:43:55.290240 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:43:55.290725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:43:55.291143 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:43:55.291563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:43:55.300741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:55.301559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:55.302864 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:55.303522 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:55.326046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:55.326642 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for project 409ea4c0034a4318bdae3a2b20926927. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:43:55.329253 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:55.331562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Getting quotas for user 0b2bb1ad3b4340dd95a7ac5157c55f1a and project 409ea4c0034a4318bdae3a2b20926927. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:43:55.341765 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:55.342542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:55.343708 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:55.344964 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:55.346835 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:43:55.349574 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7447f8d8-1eae-4d22-823b-5150499ca118',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:43:55.419682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-019bb3f5-338f-420d-877a-12e226cf01d5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.037649 May 18 01:43:55.428142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 337/709] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:43:54 2021] POST /compute/v2.1/servers => generated 402 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 01:43:55.442345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-411dc248-f256-48a6-9c74-097538b1a9f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:55.451872 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-411dc248-f256-48a6-9c74-097538b1a9f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:55.489617 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-963533a1-88fd-4caf-8665-a5ab2263c019 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.168601 May 18 01:43:55.490793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 373/710] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:55 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:55.694243 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-411dc248-f256-48a6-9c74-097538b1a9f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:55.704365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-411dc248-f256-48a6-9c74-097538b1a9f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1236 microversion: 2.1 time: 0.269079 May 18 01:43:55.705837 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 338/711] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:55 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1236 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:43:56.501645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:56.503210 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:56.513010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:56.513811 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:56.514823 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:56.515547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:56.617645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8c7d681f-a707-4f8d-a504-8ec9b5da3350 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.120240 May 18 01:43:56.621739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 374/712] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:56 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:56.722737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:56.723416 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:56.731533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:56.731898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:56.732703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:56.733308 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:56.876510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:56.886748 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a3b33135-eadd-483c-b51e-a04dadc26f03 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1306 microversion: 2.1 time: 0.167297 May 18 01:43:56.912995 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 339/713] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:56 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:43:57.633363 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:57.635346 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:57.660278 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:57.661579 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:57.664407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:57.665616 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:57.800666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f56a8965-ff1e-4b6e-8c78-5c01eb831d01 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 14 microversion: 2.20 time: 0.174166 May 18 01:43:57.801488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 375/714] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:57 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:57.903472 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:57.904943 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:57.921978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:57.922769 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:57.923788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:57.924471 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:58.662368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:43:58.672319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9d0f9e7b-2ece-4b48-bf4f-ebe600c4de48 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.772464 May 18 01:43:58.673197 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 340/715] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:57 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:43:58.823967 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:58.825088 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:58.843163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:58.849073 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:58.850648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:58.851096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:59.057522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-94d6a9cf-64da-4b1c-b835-7f9e717a450c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 11629 microversion: 2.20 time: 0.247844 May 18 01:43:59.061259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 376/716] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:43:58 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 11629 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:43:59.689507 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:43:59.690273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:43:59.713061 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-a690fc43-823d-4c94-ba49-d8da9a04e107 req-65b61b63-a1c2-4a44-b714-437ad7884ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a643178-61ea-4a22-8f16-4af570d863e2", "tag": "8f6dc203-9fc5-4a53-b523-347e7a553ff4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:43:59.714722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:43:59.714722 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:43:59.721610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:59.728170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:59.729113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:59.729647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:59.762516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a690fc43-823d-4c94-ba49-d8da9a04e107 req-65b61b63-a1c2-4a44-b714-437ad7884ef3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:43:59.763124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a690fc43-823d-4c94-ba49-d8da9a04e107 req-65b61b63-a1c2-4a44-b714-437ad7884ef3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:43:59.786762 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-a690fc43-823d-4c94-ba49-d8da9a04e107 req-65b61b63-a1c2-4a44-b714-437ad7884ef3 service nova] Creating event network-changed:8f6dc203-9fc5-4a53-b523-347e7a553ff4 for instance 4a643178-61ea-4a22-8f16-4af570d863e2 on hv-cinder-78462 May 18 01:43:59.796385 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-a690fc43-823d-4c94-ba49-d8da9a04e107 req-65b61b63-a1c2-4a44-b714-437ad7884ef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084763 May 18 01:43:59.798206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 377/717] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:43:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:44:00.070257 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:00.071393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:00.094285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:00.094903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:00.096972 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:00.097633 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:00.229520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-885a221a-3d82-456a-bb3d-8f73cee1a7ec tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 18561 microversion: 2.20 time: 0.164018 May 18 01:44:00.230658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 378/718] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:00 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 18561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:00.343519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:00.356349 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-158f2baa-4cd3-456a-8e82-93e9c7cc076e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.670860 May 18 01:44:00.366912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 341/719] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:43:59 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:01.242995 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:01.244872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:01.261791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:01.262592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:01.265131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:01.265813 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:01.374658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:01.376344 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:01.388660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-92d19175-b8d7-476b-9231-865a0c6aee1c tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 19342 microversion: 2.20 time: 0.150741 May 18 01:44:01.391472 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:01.397794 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 379/720] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:01 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 19342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:01.398797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:01.399830 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:01.400464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:01.786080 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:01.795004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2b31a41d-6006-407e-9357-416fb7a89008 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.424859 May 18 01:44:01.805425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 342/721] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:01 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:02.405475 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:02.406430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:02.415682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:02.416135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:02.416966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:02.417408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:02.522900 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4d592ad1-df2b-4c20-90ae-fc42c2032d75 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 22021 microversion: 2.20 time: 0.121258 May 18 01:44:02.527266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 380/722] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:02 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 22021 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:02.814609 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:02.816377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:02.827519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:02.828210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:02.829255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:02.829792 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:03.054924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:03.063518 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-093ae9fd-8071-4c97-97dc-62f2436514f9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.253772 May 18 01:44:03.064093 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 343/723] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:02 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:03.535547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:03.537751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:03.545933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:03.546394 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:03.547183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:03.547623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:03.644480 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-95ffbb7f-744e-4628-aefc-40d112148f6a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 23563 microversion: 2.20 time: 0.113041 May 18 01:44:03.648258 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 381/724] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:03 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 23563 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:03.875814 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Action: 'create', calling method: .version_select at 0x7efcd8d6e8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-457100581"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:03.899512 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:44:03.904620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for user 257328ddbc2b426bbcc9450bea59c08f and project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:44:04.051663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:44:04.056509 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for user 257328ddbc2b426bbcc9450bea59c08f and project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'key_pairs'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:44:04.070783 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c9551b99-65de-44f0-b58a-d20b965ce014 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.373611 May 18 01:44:04.071309 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 344/725] 10.222.0.16 () {60 vars in 1158 bytes} [Tue May 18 01:44:03 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:04.082395 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:04.086042 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:04.104065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:04.109036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:04.110117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:04.110403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:04.411896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:04.420976 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-df3e96c6-fa53-4205-8457-6632eacda12e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.342680 May 18 01:44:04.430801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 382/726] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:04 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:04.656014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:04.656967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:04.665383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:04.665910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:04.666873 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:04.667461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:04.763925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0b2c98d2-6192-4a4d-b032-b559a13e7c88 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 25016 microversion: 2.20 time: 0.111696 May 18 01:44:04.764824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 345/727] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:04 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 25016 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:05.357942 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-7fd1b5a9-e14b-4a1b-bda9-0b5cbbcb134a req-088e7aae-9585-4ea3-b92f-c07e0248154b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a643178-61ea-4a22-8f16-4af570d863e2", "name": "network-vif-plugged", "status": "completed", "tag": "8f6dc203-9fc5-4a53-b523-347e7a553ff4"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:05.366276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:05.366276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:44:05.393212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-7fd1b5a9-e14b-4a1b-bda9-0b5cbbcb134a req-088e7aae-9585-4ea3-b92f-c07e0248154b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:05.393856 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-7fd1b5a9-e14b-4a1b-bda9-0b5cbbcb134a req-088e7aae-9585-4ea3-b92f-c07e0248154b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:05.411030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-7fd1b5a9-e14b-4a1b-bda9-0b5cbbcb134a req-088e7aae-9585-4ea3-b92f-c07e0248154b service nova] Creating event network-vif-plugged:8f6dc203-9fc5-4a53-b523-347e7a553ff4 for instance 4a643178-61ea-4a22-8f16-4af570d863e2 on hv-cinder-78462 May 18 01:44:05.416266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-7fd1b5a9-e14b-4a1b-bda9-0b5cbbcb134a req-088e7aae-9585-4ea3-b92f-c07e0248154b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133109 May 18 01:44:05.416880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 383/728] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:05.441729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:05.442453 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:05.455084 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:05.455534 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:05.456534 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:05.457167 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:05.778013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:05.779180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:05.787870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:05.788348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:05.789263 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:05.789701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:05.850804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:05.863330 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-eab560b7-8a63-4dd8-aa0c-8e653f22a6f1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1362 microversion: 2.1 time: 0.428596 May 18 01:44:05.864013 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 346/729] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:05 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:05.941107 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-46b2038f-934d-4b79-a4d5-319b0fcc8721 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 26597 microversion: 2.20 time: 0.167990 May 18 01:44:05.942012 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 384/730] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:05 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 26597 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:06.882298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:06.882911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:06.890519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:06.890968 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:06.891732 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:06.892165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:06.953713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:06.955298 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:06.970923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:06.971997 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:06.974478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:06.975392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:07.078935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-81cdf89e-5dd4-4849-b935-cf22575c3868 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 27388 microversion: 2.20 time: 0.129562 May 18 01:44:07.083365 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 385/731] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:06 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 27388 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:07.118893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:07.127305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4b073764-0468-477f-b35d-30779e99d6c1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1547 microversion: 2.1 time: 0.249789 May 18 01:44:07.127875 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 347/732] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:06 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1547 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:07.144569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:07.145492 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:07.153776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:07.154239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:07.155036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:07.155481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:07.313123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b2d1c105-1d8f-44c5-b027-f7db2070d223 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172778 May 18 01:44:07.313723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 386/733] 10.222.0.16 () {58 vars in 1275 bytes} [Tue May 18 01:44:07 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:08.095740 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:08.097858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:08.107331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:08.108175 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:08.109222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:08.109880 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:08.222458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7da7a091-7387-441f-a815-893c7f1f2e80 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 27915 microversion: 2.20 time: 0.135025 May 18 01:44:08.223114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 348/734] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:08 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 27915 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:08.996107 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:08.997240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:09.015796 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:09.019633 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:09.021421 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:09.021938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:09.069834 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-b0fbc0ed-a5a0-4a45-b1e3-13416a863434 req-fb7eb75c-3021-4699-86bc-6a431e88ca13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a643178-61ea-4a22-8f16-4af570d863e2", "tag": "8f6dc203-9fc5-4a53-b523-347e7a553ff4"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:09.071571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:09.071571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:44:09.080456 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-b0fbc0ed-a5a0-4a45-b1e3-13416a863434 req-fb7eb75c-3021-4699-86bc-6a431e88ca13 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:09.081210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-b0fbc0ed-a5a0-4a45-b1e3-13416a863434 req-fb7eb75c-3021-4699-86bc-6a431e88ca13 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:09.102051 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-b0fbc0ed-a5a0-4a45-b1e3-13416a863434 req-fb7eb75c-3021-4699-86bc-6a431e88ca13 service nova] Creating event network-changed:8f6dc203-9fc5-4a53-b523-347e7a553ff4 for instance 4a643178-61ea-4a22-8f16-4af570d863e2 on hv-cinder-78462 May 18 01:44:09.106965 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-b0fbc0ed-a5a0-4a45-b1e3-13416a863434 req-fb7eb75c-3021-4699-86bc-6a431e88ca13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118186 May 18 01:44:09.108111 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 349/735] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:09.138122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-995abe8d-8c90-46d5-84cb-c9e4625980e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.152697 May 18 01:44:09.139369 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 387/736] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:08 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:09.235005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:09.236151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:09.245180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:09.246273 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:09.247285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:09.248023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:09.359164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6e3b02fd-9d2e-4d1b-80fa-e0fd48aa97fc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28228 microversion: 2.20 time: 0.128195 May 18 01:44:09.360335 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 350/737] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:09 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:10.149693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:10.150709 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:10.159630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:10.160095 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:10.161011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:10.161371 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:10.282004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ed7a687d-c6ed-47e1-b78a-1e078f13f998 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.136593 May 18 01:44:10.282701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 388/738] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:10 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 01:44:10.371753 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:10.372826 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:10.381391 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:10.382211 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:10.383019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:10.383459 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:10.494388 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-86736265-f7a1-4332-820d-ca8dd20ac2dd tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28228 microversion: 2.20 time: 0.126606 May 18 01:44:10.495276 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 351/739] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:10 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28228 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:11.293717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:11.294668 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:11.302676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:11.303116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:11.303902 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:11.304373 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:11.402562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6aef1c67-eba2-445d-b63d-3ddb2a5a51c9 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.112881 May 18 01:44:11.403207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 389/740] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:11 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:11.508550 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:11.509566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:11.517705 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:11.519205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:11.519205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:11.519431 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:11.619668 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5bd478e2-340e-46bb-ac3c-2cd7b52239bf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28519 microversion: 2.20 time: 0.116134 May 18 01:44:11.620817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 352/741] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:11 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28519 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:12.413972 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:12.414993 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:12.422925 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:12.423383 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:12.424163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:12.424639 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:12.515674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ddf46f56-4712-4fa4-adcc-2c38e5cfe471 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.106545 May 18 01:44:12.516337 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 390/742] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:12 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:12.631843 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:12.632882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:12.640988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:12.641484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:12.642255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:12.642700 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:12.741777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-768cffc4-61e8-478f-a2c0-6668682b8466 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28687 microversion: 2.20 time: 0.114478 May 18 01:44:12.742422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 353/743] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:12 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28687 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:13.527081 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:13.528098 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:13.535932 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:13.536424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:13.537880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:13.538324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:13.641183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-521f772c-2d07-467f-9b29-c4c548563c8f tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.118031 May 18 01:44:13.641850 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 391/744] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:13 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:13.753686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:13.754704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:13.763010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:13.763469 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:13.764253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:13.764723 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:13.861549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d9013423-8278-4478-9e62-9ab4b16e9c60 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28687 microversion: 2.20 time: 0.111798 May 18 01:44:13.862198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 354/745] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:13 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28687 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:14.653206 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:14.654224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:14.662240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:14.662697 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:14.664106 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:14.664571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:14.765622 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-695d8551-f37e-4b60-b15d-84d7f921d0e0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.116235 May 18 01:44:14.766270 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 392/746] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:14 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:14.873775 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:14.875135 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:14.887614 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:14.888069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:14.888891 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:14.889332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:14.985788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e9647b68-fb4c-499c-bcfe-68fa1c7e3863 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28687 microversion: 2.20 time: 0.116062 May 18 01:44:14.986442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 355/747] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:14 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28687 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:15.777474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:15.778505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:15.786399 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:15.786966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:15.787819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:15.789054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:15.882591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-470984a7-a7f6-4b93-a177-79fc97c06602 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.108841 May 18 01:44:15.883237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 393/748] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:15 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:15.998476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:15.999464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:16.007138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:16.008076 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:16.008903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:16.009381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:16.121301 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-837d7efb-b99f-40fd-9de3-c2b772198a2f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 28719 microversion: 2.20 time: 0.126752 May 18 01:44:16.121964 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 356/749] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:15 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 28719 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:16.894085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:16.895096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:16.904109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:16.904648 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:16.909525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:16.909525 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:17.007883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5e735b9c-bc75-45f6-abc7-3fd00b31ebda tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.117738 May 18 01:44:17.008555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 394/750] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:16 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:17.136069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:17.137028 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:17.144816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:17.145258 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:17.146022 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:17.146482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:17.245453 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cbac6c55-479f-4fd8-89c0-d6a2dde9dbce tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 30371 microversion: 2.20 time: 0.113994 May 18 01:44:17.246111 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 357/751] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:17 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 30371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:18.019741 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:18.020794 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:18.028784 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:18.029237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:18.030006 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:18.030448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:18.133764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6de51301-9161-44a2-8e7a-68d928311a7c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.118032 May 18 01:44:18.134564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 395/752] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:18 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:18.256786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:18.257811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:18.265936 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:18.266389 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:18.267167 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:18.267610 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:18.363997 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0feeb11e-8ec5-4f46-b848-442ce01d474e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 31975 microversion: 2.20 time: 0.111393 May 18 01:44:18.364930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 358/753] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:18 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 31975 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:19.145235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:19.146245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:19.154624 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:19.155081 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:19.155855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:19.156320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:19.253563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-92cbd493-40b2-4a10-b31f-66171407272b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 14 microversion: 2.1 time: 0.112195 May 18 01:44:19.254297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 396/754] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:19 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:44:19.375808 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:19.376856 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:19.384683 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:19.385127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:19.385889 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:19.386319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:19.484449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2448fad5-92e1-41c2-8507-d52048367d37 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 33167 microversion: 2.20 time: 0.112859 May 18 01:44:19.485059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 359/755] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:19 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 33167 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:20.264819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:20.265850 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:20.273825 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:20.274281 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:20.275068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:20.275490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:20.373115 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-30301e98-0ad3-46dc-b48c-3c4667e21404 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 6451 microversion: 2.1 time: 0.112314 May 18 01:44:20.374010 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 397/756] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:20 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 6451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:20.496642 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:20.497636 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:20.505378 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:20.505825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:20.506582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:20.507103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:20.615153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-03c06494-1dee-47ce-9cb7-268c14df7101 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 33757 microversion: 2.20 time: 0.122539 May 18 01:44:20.615796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 360/757] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:20 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 33757 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:21.385177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:21.386185 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:21.394144 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:21.394610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:21.395397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:21.395835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:21.498731 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a38ef3c7-55aa-43fd-8051-8c6c73bc1c61 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 15025 microversion: 2.1 time: 0.118101 May 18 01:44:21.500146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 398/758] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:21 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 15025 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:21.627563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:21.628653 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:21.637796 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:21.638193 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:21.638977 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:21.639421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:21.660834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1971527021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457100581", "security_groups": [{"name": "tempest-secgroup-smoke-1203183692"}], "block_device_mapping_v2": [{"uuid": "f0b29083-095a-49ad-a8a6-46feee91265a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2192753-81de-4186-86a3-1e0d48f6a9fe"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:21.735906 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5209dd1c-db1b-4c36-89da-027069902c1d tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 34638 microversion: 2.20 time: 0.112459 May 18 01:44:21.736581 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 361/759] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:21 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 34638 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:21.817674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] validate_networks() for [('f2192753-81de-4186-86a3-1e0d48f6a9fe', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:44:22.344953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:44:22.345399 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:44:22.345892 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:44:22.346312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:44:22.346788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:44:22.355380 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.355847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.356693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.357172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.374119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:44:22.378072 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for user 257328ddbc2b426bbcc9450bea59c08f and project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:44:22.479839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:44:22.482084 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0b29083-095a-49ad-a8a6-46feee91265a',volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:44:22.511368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:22.512387 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:22.520151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.520637 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.521409 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.521846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.626554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-fd7e27d0-d4a3-4d9d-85af-b88aefd74dca tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 18398 microversion: 2.1 time: 0.120266 May 18 01:44:22.627203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 362/760] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:22 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 18398 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:22.651057 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-901dc592-769e-4cf6-8ed9-1c6c44705ae3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994325 May 18 01:44:22.651694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 399/761] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:44:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 01:44:22.662035 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-2674f2d6-1cde-4a51-a0be-844187b9d4d3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:22.662742 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-2674f2d6-1cde-4a51-a0be-844187b9d4d3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:22.732205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-2674f2d6-1cde-4a51-a0be-844187b9d4d3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:22.739731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-2674f2d6-1cde-4a51-a0be-844187b9d4d3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1094 microversion: 2.1 time: 0.081712 May 18 01:44:22.740294 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 363/762] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:22 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:22.748715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:22.749689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:22.758334 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.758780 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.759556 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:22.760071 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:22.860824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d632df19-ec8b-40a3-9263-79ab8b5e2ded tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 35781 microversion: 2.20 time: 0.116102 May 18 01:44:22.865009 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 400/763] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:22 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 35781 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:23.638008 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:23.638991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:23.759306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:23.760863 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:23.770103 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.770962 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:23.772027 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.773254 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:23.817207 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.817790 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:23.818447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.818903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:23.934987 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-931e7163-a5e9-4d20-92d7-77abb1dd6d6d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 19539 microversion: 2.1 time: 0.300439 May 18 01:44:23.936341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:23.936699 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 364/764] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:23 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 19539 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:23.944173 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:23.945184 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-888707e3-87ca-4238-a467-91599461cfd5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1210 microversion: 2.1 time: 0.190006 May 18 01:44:23.945774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 401/765] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:23 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1210 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:44:23.947203 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:23.961566 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.962417 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:23.964116 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:23.964806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:24.071005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-456e5214-4686-4386-b61c-48ec4d2b94a7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 37426 microversion: 2.20 time: 0.132647 May 18 01:44:24.072670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 365/766] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:23 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 37426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:24.948076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:24.949210 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:24.961861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:24.962939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:24.963409 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:24.964400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:24.965415 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:24.965880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:24.972863 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:24.973602 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:24.974647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:24.975331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:25.076047 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ccade378-f150-4c04-b84a-50875ff7486e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 22488 microversion: 2.1 time: 0.132649 May 18 01:44:25.077852 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 402/767] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:24 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 22488 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:25.083080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:25.084355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:25.092939 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:25.093401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:25.094180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:25.094623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:25.191007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c73695fd-a8da-42ab-8d6b-ef4af7d96983 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 38246 microversion: 2.20 time: 0.111569 May 18 01:44:25.191907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 403/768] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:25 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 38246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:25.384004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:25.392113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cb782e94-46cb-4d32-a8e9-330ac195cd83 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.433841 May 18 01:44:25.401665 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 366/769] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:24 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:25.896348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-eb2e26fd-5eee-4334-96da-b1fe2bdc8682 req-612d5212-d5ac-4729-b5d0-5afee60fd69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09f17e-cba4-4ef5-9feb-b13cee531b03", "tag": "2bdedcf4-34b1-4847-a5c3-5cacd258a734"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:25.897982 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:25.897982 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:44:25.907040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-eb2e26fd-5eee-4334-96da-b1fe2bdc8682 req-612d5212-d5ac-4729-b5d0-5afee60fd69b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:25.907574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-eb2e26fd-5eee-4334-96da-b1fe2bdc8682 req-612d5212-d5ac-4729-b5d0-5afee60fd69b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:25.924536 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-eb2e26fd-5eee-4334-96da-b1fe2bdc8682 req-612d5212-d5ac-4729-b5d0-5afee60fd69b service nova] Creating event network-changed:2bdedcf4-34b1-4847-a5c3-5cacd258a734 for instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 on hv-cinder-78462 May 18 01:44:25.930878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-eb2e26fd-5eee-4334-96da-b1fe2bdc8682 req-612d5212-d5ac-4729-b5d0-5afee60fd69b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039069 May 18 01:44:25.931279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 404/770] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:26.089099 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:26.090319 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:26.103538 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.104001 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.104822 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.105288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.203678 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:26.204255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4bc59dc5-5dfa-41fc-a718-1db660e2c48a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 23798 microversion: 2.1 time: 0.120380 May 18 01:44:26.204853 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 367/771] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:26 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 23798 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:26.207849 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:26.217001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.217519 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.218306 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.218750 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.316338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-dafd0c8f-1d95-42c5-9f3d-479d33b19424 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 38246 microversion: 2.20 time: 0.116645 May 18 01:44:26.316983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 405/772] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:26 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 38246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:26.410485 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:26.411109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:26.419218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.419674 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.420500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:26.420941 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:26.755825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:26.764101 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-20be75bb-e8ba-48f4-b7de-ae331fde9ad5 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.358531 May 18 01:44:26.764718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 368/773] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:26 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:27.216354 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:27.217282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:27.225146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.225606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.226771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.227220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.323877 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-43e5110f-6299-40aa-8c8d-bb5eb387c810 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 25346 microversion: 2.1 time: 0.111676 May 18 01:44:27.325119 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 406/774] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:27 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 25346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:27.328893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:27.330362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:27.340750 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.341210 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.341997 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.342429 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.448957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-831eaca0-0275-44ee-a0d9-854737e4c45a tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 38246 microversion: 2.20 time: 0.123540 May 18 01:44:27.453142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 369/775] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:27 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 38246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:27.781966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:27.782662 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:27.790712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.791162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.791935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:27.792408 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:27.990682 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:27.999534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a181f5d7-7f0f-47fd-85cf-1f87452a18cc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.221765 May 18 01:44:28.000104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 407/776] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:27 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:28.337034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:28.338037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:28.346043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:28.346486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:28.347252 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:28.347746 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:28.442331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c64357a8-cd83-47f1-b70b-580acc5f08c4 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 26752 microversion: 2.1 time: 0.109870 May 18 01:44:28.442968 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 370/777] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:28 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 26752 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:28.461402 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:28.462393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:28.470364 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:28.470824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:28.471610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:28.472054 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:28.571581 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a29806fb-8d4f-4fd3-ae4b-3226bb3697ca tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 38246 microversion: 2.20 time: 0.114183 May 18 01:44:28.573143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 408/778] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:28 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 38246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 18 01:44:29.017510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:29.018209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:29.026064 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.026519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.027284 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.027713 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.216493 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:29.224525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7f432395-0c92-4f68-ad3c-a793974984ab tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.211123 May 18 01:44:29.225080 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 371/779] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:29 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:29.454608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:29.455614 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:29.464761 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.465324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.465977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.466420 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.560600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-85b7d75f-3583-498e-9d65-d1b8a9562592 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 27697 microversion: 2.1 time: 0.109905 May 18 01:44:29.561220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 409/780] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:29 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 27697 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:29.582895 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:29.584083 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:29.592010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.592517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.593299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.593744 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.686044 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-06a5ead5-bfc8-482d-b015-b0a318c71b03 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 200 len: 38389 microversion: 2.20 time: 0.106699 May 18 01:44:29.686632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 372/781] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:29 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 38389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 18 01:44:29.697444 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:29.698032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:29.705893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.706352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.707126 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:29.707567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:29.764864 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f8495216-5829-4c0d-82d7-1c2b11d1fccf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/ips" status: 200 len: 151 microversion: 2.20 time: 0.072008 May 18 01:44:29.765428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 410/782] 10.222.0.16 () {60 vars in 1289 bytes} [Tue May 18 01:44:29 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:30.243172 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:30.243874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:30.251648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:30.252110 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:30.252921 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:30.253368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:30.453128 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:30.462127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7ebf19e4-8f86-42bf-8d2d-35295fc15610 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.223982 May 18 01:44:30.462688 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 373/783] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:30 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:30.572609 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:30.573540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:30.580855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:30.581315 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:30.582099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:30.582548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:30.676284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-62a275ff-037f-4d5c-b8e7-b2b85d85a6f2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28177 microversion: 2.1 time: 0.107811 May 18 01:44:30.676929 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 411/784] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:30 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28177 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:31.479447 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:31.480098 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:31.487795 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.488360 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:31.489081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.489518 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:31.684806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:31.687824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:31.688883 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:31.692985 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-85197f0b-f56d-4413-b6c6-de06cbaf65eb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.217623 May 18 01:44:31.693553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 374/785] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:31 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:31.696950 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.697403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:31.698184 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.698625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:31.794356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fa617194-fb0f-42d8-a40c-176cee4be6e1 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28179 microversion: 2.1 time: 0.110441 May 18 01:44:31.794936 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 412/786] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:31 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:31.961844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:31.962379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:31.969590 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.970038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:31.970803 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:31.971261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.025778 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.objects.instance [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lazy-loading 'flavor' on Instance uuid acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 {{(pid=92948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:44:32.357211 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-171994ce-27b0-47ca-af8d-8cf6f75aa048 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 202 len: 0 microversion: 2.20 time: 0.399722 May 18 01:44:32.357826 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 375/787] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:31 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 01:44:32.366983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:32.367706 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:32.375734 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.376192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.377015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.377462 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.573362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:32.581899 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:32.583403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:32.584897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fa5768f8-c1e5-4668-b550-7ae353888d8e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.222484 May 18 01:44:32.585523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 413/788] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:32 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:32.710342 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:32.711050 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:32.718583 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.719048 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.719824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.720264 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.806515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:32.807358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:32.814608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.815067 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.815851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:32.816291 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:32.915089 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-145cef6f-5873-4e28-bee6-d2e905db1da2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28324 microversion: 2.1 time: 0.112851 May 18 01:44:32.916290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 414/789] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:32 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:32.918485 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:32.926798 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1e78ea37-8df1-4b91-ae54-bbcf4f90cba9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.220863 May 18 01:44:32.927437 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 376/790] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:32 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:33.603413 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:33.604107 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:33.611901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.612379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:33.613141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.613574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:33.885862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:33.894608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:33.896114 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:33.897259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-4c621b0e-08ad-407c-b260-5f947c105fde tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.298057 May 18 01:44:33.898694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 415/791] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:33 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:33.927243 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:33.928223 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:33.936967 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.937427 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:33.939715 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.940165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:33.944032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:33.945715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:33.953183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.953704 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:33.954541 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:33.955049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:34.038436 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5e2de199-5760-4723-ad21-db218962a06d tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28638 microversion: 2.1 time: 0.114511 May 18 01:44:34.039035 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 377/792] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:33 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28638 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:34.149363 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:34.157507 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a3cf697f-6b3a-4786-aece-059039d9c7d6 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.217365 May 18 01:44:34.158068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 416/793] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:33 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:44:34.916829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:34.917457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:34.925318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:34.925771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:34.926547 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:34.926984 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:35.049557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:35.050482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:35.058587 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:35.059044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:35.059815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:35.060281 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:35.124336 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:35.133337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:35.134858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:35.136055 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-07f7e50e-8ae6-4ad4-bf2a-075e155b121b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.223555 May 18 01:44:35.136636 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 378/794] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:34 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:35.159351 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-24c0c379-3e2b-47bc-a465-83ebfddf6be5 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28638 microversion: 2.1 time: 0.113410 May 18 01:44:35.159992 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 417/795] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:35 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28638 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:35.174315 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:35.174897 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:35.182677 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:35.183156 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:35.183929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:35.184400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:35.383147 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:35.391488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f74c195b-ec8b-4831-a6d9-7d0466d9ff60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.220770 May 18 01:44:35.392058 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 379/796] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:35 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:36.155230 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:36.155931 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:36.163866 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.164344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.165133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.165903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.170752 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:36.171667 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:36.180892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.181347 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.182151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.182592 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.284092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6be75b9c-17cf-456e-9fd6-6113807d0ebb tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28638 microversion: 2.1 time: 0.116695 May 18 01:44:36.284944 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 380/797] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:36 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28638 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:36.409324 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:36.410025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:36.417806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.418260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.419042 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:36.419479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:36.554880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:36.563529 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:36.565058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:36.566209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-713ddcbb-4aa0-491f-9a63-d0041534eb65 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.415320 May 18 01:44:36.566757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 418/798] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:36 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:44:36.633270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:36.641393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e1924460-bca3-406b-90a6-37e15145a107 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.236174 May 18 01:44:36.641966 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 381/799] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:36 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:44:37.295650 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:37.296712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:37.304978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.305440 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.306216 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.306661 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.400881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fb6908b2-560d-49e6-878c-78f032f89997 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 28670 microversion: 2.1 time: 0.108688 May 18 01:44:37.401773 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 419/800] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:37 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 28670 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:37.496633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-31dd84cf-2126-446e-98b8-b21de3b3b545 req-a0509a66-81e2-4627-b618-471390a8d87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09f17e-cba4-4ef5-9feb-b13cee531b03", "name": "network-vif-plugged", "status": "completed", "tag": "2bdedcf4-34b1-4847-a5c3-5cacd258a734"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:37.498494 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:37.498494 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:44:37.507757 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-31dd84cf-2126-446e-98b8-b21de3b3b545 req-a0509a66-81e2-4627-b618-471390a8d87c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.508131 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-31dd84cf-2126-446e-98b8-b21de3b3b545 req-a0509a66-81e2-4627-b618-471390a8d87c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.524114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-31dd84cf-2126-446e-98b8-b21de3b3b545 req-a0509a66-81e2-4627-b618-471390a8d87c service nova] Creating event network-vif-plugged:2bdedcf4-34b1-4847-a5c3-5cacd258a734 for instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 on hv-cinder-78462 May 18 01:44:37.528727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-31dd84cf-2126-446e-98b8-b21de3b3b545 req-a0509a66-81e2-4627-b618-471390a8d87c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035742 May 18 01:44:37.529311 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 382/801] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:37.585511 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:37.586201 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:37.594002 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.594451 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.595219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.595657 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.659274 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:37.660126 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:37.669353 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.669830 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.670613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:37.671041 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:37.899857 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:37.908472 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:37.910249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:37.911386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9ce7b90e-9237-40ca-b36c-aea478350486 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.330374 May 18 01:44:37.922498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 420/802] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:37 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:38.004620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:38.012809 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-82c14aba-92be-4f0e-a380-5976d9989647 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1266 microversion: 2.1 time: 0.357599 May 18 01:44:38.013383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 383/803] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:37 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:38.412392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:38.413318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:38.420582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:38.421036 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:38.421809 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:38.422247 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:38.517318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c69e1113-33a3-4aa5-9f46-2bb36194915c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 30707 microversion: 2.1 time: 0.108546 May 18 01:44:38.517928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 421/804] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:38 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 30707 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:38.929897 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:38.931052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:38.938876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:38.939329 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:38.940141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:38.940633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.030177 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:39.030908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:39.039853 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.040616 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.041484 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.042027 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.180383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:39.189297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:39.190830 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:39.192000 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c140a3eb-5441-43d4-85b7-e306ffcc66c2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.266556 May 18 01:44:39.192794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 384/805] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:38 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:39.253979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:39.262562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ad2912b0-ca8c-4144-9b8e-c8f02a858aff tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1453 microversion: 2.1 time: 0.236676 May 18 01:44:39.263150 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 422/806] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:39 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1453 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:44:39.278698 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:39.279422 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:39.286504 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.286952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.287711 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.288142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.481204 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:39.489279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-de19a0d1-c545-4a0b-abb8-0e93c03f4d30 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1453 microversion: 2.1 time: 0.214230 May 18 01:44:39.489839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 385/807] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:44:39 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:44:39.529275 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:39.530352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:39.537592 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.538047 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.538953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:39.539482 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:39.638207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-df889594-2d03-4e7a-b792-02e3d4052a91 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 32561 microversion: 2.1 time: 0.112395 May 18 01:44:39.642183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 423/808] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:39 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 32561 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:40.210968 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:40.212222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:40.229490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:40.229851 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:40.230642 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:40.231077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:40.651732 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:40.652831 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:40.660679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:40.661135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:40.661908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:40.662349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:40.664179 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:40.673184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:40.675090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:40.676435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-da4c75dc-b039-4348-a31d-1d61bd695898 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.470063 May 18 01:44:40.677285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 386/809] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:40 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:40.761660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8f7cc183-2884-4f4f-890d-160435cb0719 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 33678 microversion: 2.1 time: 0.115105 May 18 01:44:40.763171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 424/810] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:40 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 33678 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:41.696034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:41.696787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:41.704582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:41.705038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:41.705828 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:41.706300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:41.774585 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:41.775699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:41.784347 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:41.784589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:41.785243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:41.785681 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:41.879634 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b3f76a11-dbd1-4cf1-ba22-50a3f5785f3a tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 34889 microversion: 2.1 time: 0.109239 May 18 01:44:41.880480 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 425/811] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:41 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 34889 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:42.072075 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:42.080797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:42.082328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:42.083460 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d237f5d3-0e61-44d0-9a76-1732d2212dd5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.392123 May 18 01:44:42.084278 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 387/812] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:41 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:42.203081 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-a6cf46ad-e3c9-4686-80b2-12178cb38d60 req-874552d8-e5a5-425f-89d7-836c9873cb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09f17e-cba4-4ef5-9feb-b13cee531b03", "tag": "2bdedcf4-34b1-4847-a5c3-5cacd258a734"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:42.204815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:42.204815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:44:42.214611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a6cf46ad-e3c9-4686-80b2-12178cb38d60 req-874552d8-e5a5-425f-89d7-836c9873cb58 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:42.215056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a6cf46ad-e3c9-4686-80b2-12178cb38d60 req-874552d8-e5a5-425f-89d7-836c9873cb58 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:42.231785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-a6cf46ad-e3c9-4686-80b2-12178cb38d60 req-874552d8-e5a5-425f-89d7-836c9873cb58 service nova] Creating event network-changed:2bdedcf4-34b1-4847-a5c3-5cacd258a734 for instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 on hv-cinder-78462 May 18 01:44:42.236438 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-a6cf46ad-e3c9-4686-80b2-12178cb38d60 req-874552d8-e5a5-425f-89d7-836c9873cb58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 May 18 01:44:42.237225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 426/813] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:42.892578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:42.893529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:42.901904 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:42.902353 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:42.903301 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:42.903741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:43.008338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-752a9c36-75e9-455a-bc22-2773e99f02c7 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 36057 microversion: 2.1 time: 0.119236 May 18 01:44:43.009257 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 388/814] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:42 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 36057 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:43.103123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:43.103815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:43.111568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:43.112055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:43.112869 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:43.113320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:43.312340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:43.321207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:43.322725 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:43.323867 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-026a6f89-9564-4c48-b57b-f941170cb8fb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1744 microversion: 2.20 time: 0.225777 May 18 01:44:43.324466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 427/815] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:43 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:44.021026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:44.022021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:44.030575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:44.031026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:44.031791 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:44.032223 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:44.133192 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3dc38dc7-7480-4a6e-97f2-a9a8e73eecde tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 37011 microversion: 2.1 time: 0.115718 May 18 01:44:44.133805 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 389/816] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:44 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 37011 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:44.342898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:44.343550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:44.350786 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:44.351451 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:44.352569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:44.353019 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:44.547034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:44.556573 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:44.558090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:44.559221 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cee8783a-c4df-468c-b6f4-f4ad9324ca36 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1744 microversion: 2.20 time: 0.220021 May 18 01:44:44.559795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 428/817] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:44 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:45.145559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:45.146556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:45.154784 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:45.155240 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:45.156464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:45.156464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:45.253219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-61467efc-9d19-4f40-9091-8aed65fc54a2 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 38077 microversion: 2.1 time: 0.111499 May 18 01:44:45.254595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 390/818] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:45 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 38077 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:45.578409 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:45.579023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:45.587356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:45.587821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:45.588694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:45.589147 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:45.815052 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:45.824693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:45.827034 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:45.828868 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-95b42e9c-206b-427f-b174-198e65744202 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.254114 May 18 01:44:45.829711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 429/819] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:45 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:44:46.267063 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:46.268109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:46.276182 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:46.276964 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:46.277832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:46.278392 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:46.386119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-977112e5-f0b7-43f4-af1f-29b43fddfeea tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 38168 microversion: 2.1 time: 0.123103 May 18 01:44:46.390523 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 391/820] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:46 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 38168 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:46.846865 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:46.847471 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:46.856104 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:46.856630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:46.857416 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:46.857855 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:47.105857 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:47.115205 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:47.117418 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:47.119128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-743ae619-23b2-4ef0-ac9c-de26b8930faf tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.275912 May 18 01:44:47.119680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 430/821] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:46 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:47.401227 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:47.403162 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:47.412665 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:47.413541 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:47.415476 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:47.416142 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:47.545372 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-51e5bfc6-2a4f-4fd0-8aa3-1ea90aa68575 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 38168 microversion: 2.1 time: 0.150544 May 18 01:44:47.546504 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 392/822] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:47 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 38168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:47.587121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-67eadbfd-0c2a-4cc6-b3a2-3f5edd96bc6e req-db6e5bac-dbfb-4d8f-864b-239002d9eb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "name": "network-vif-plugged", "status": "completed", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:47.588873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:47.588873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:44:47.601007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-67eadbfd-0c2a-4cc6-b3a2-3f5edd96bc6e req-db6e5bac-dbfb-4d8f-864b-239002d9eb7c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:47.601774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-67eadbfd-0c2a-4cc6-b3a2-3f5edd96bc6e req-db6e5bac-dbfb-4d8f-864b-239002d9eb7c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:47.623448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-67eadbfd-0c2a-4cc6-b3a2-3f5edd96bc6e req-db6e5bac-dbfb-4d8f-864b-239002d9eb7c service nova] Creating event network-vif-plugged:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:44:47.630443 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-67eadbfd-0c2a-4cc6-b3a2-3f5edd96bc6e req-db6e5bac-dbfb-4d8f-864b-239002d9eb7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049380 May 18 01:44:47.631101 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 431/823] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:48.138874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:48.139703 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:48.147764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.149019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.149893 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.150487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.486123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:48.496038 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:48.497658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:48.498811 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9e03edd9-f91e-408a-9c54-c4c2916a8776 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.364412 May 18 01:44:48.499686 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 393/824] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:48 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:44:48.558978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:48.560127 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:48.567872 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.568353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.569129 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.569563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.675328 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e12c9967-a1f1-4c68-8794-f6d130b3f197 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action" status: 200 len: 38297 microversion: 2.1 time: 0.121068 May 18 01:44:48.676231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 432/825] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:44:48 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/action => generated 38297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 01:44:48.686153 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:48.687323 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:48.697797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.698263 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.699056 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:48.699500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:48.760573 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-98b08ee5-628e-4e7d-b011-5275fae314f6 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/ips" status: 200 len: 144 microversion: 2.1 time: 0.078125 May 18 01:44:48.766407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 394/826] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:44:48 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/ips => generated 144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:49.519215 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:49.520251 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:49.529401 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:49.530183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:49.531183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:49.531833 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:49.742687 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:49.752023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:49.753589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:49.754739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bb9e4f5f-b525-4e3b-b98c-376f1c6342a3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.239983 May 18 01:44:49.755318 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 433/827] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:49 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:50.342333 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e54abfc-e559-46c6-90b9-effdb3e3a932"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:50.343384 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:50.351662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:50.352112 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:50.353009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:50.353635 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:50.748421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c57589c7-2228-4a5c-bc92-b8665da9fe4b tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409621 May 18 01:44:50.754395 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 395/828] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:44:50 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:50.775063 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:50.775791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:50.792905 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:50.793488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:50.794424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:50.795178 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:51.036984 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:51.049349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:51.051170 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:51.052542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b29bafbb-ce93-4c9b-a341-119096917be3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.283030 May 18 01:44:51.056503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 434/829] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:50 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:44:52.072767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:52.074214 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:52.083569 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:52.084636 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:52.085768 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:52.086392 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:52.309985 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:52.321520 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:52.323053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:52.324505 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ec3edb54-2842-4d4b-aca0-7120570c0d5f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.257257 May 18 01:44:52.325253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 396/830] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:52 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:53.343276 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:53.343897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:53.365817 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:53.366651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:53.367717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:53.368331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:53.779096 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:53.789751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:53.791795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:53.793141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-916d551f-ad10-41a8-aa88-22b109d4bb28 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.453664 May 18 01:44:53.794067 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 435/831] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:53 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:54.810595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:54.811206 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:54.818788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:54.819233 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:54.820567 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:54.821003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:55.021763 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:55.030843 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:55.032365 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:55.033525 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-bdb644a1-e844-48b8-9a2d-a801b29436e9 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1739 microversion: 2.20 time: 0.226562 May 18 01:44:55.034075 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 397/832] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:54 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:56.051973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:56.052630 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:56.060898 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:56.061358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:56.062133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:56.062575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:56.259888 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:56.268655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:56.270189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:56.271329 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d7a73c0c-9edf-467b-911b-faa64ba0ea9f tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1721 microversion: 2.20 time: 0.223121 May 18 01:44:56.271881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 436/833] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:56 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:57.289728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:57.290332 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:57.297676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.298140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.298911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.299339 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.502176 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:57.511957 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:57.513518 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:57.514678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-92921409-2f68-4784-ad14-dc681da82bfb tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1721 microversion: 2.20 time: 0.228708 May 18 01:44:57.515236 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 398/834] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:57 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:57.565469 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:57.566400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:57.574288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.574751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.575532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.575976 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.642130 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8953f748-fa56-4fd1-9835-85bc0cefd248 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080409 May 18 01:44:57.642676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 437/835] 10.222.0.16 () {58 vars in 1302 bytes} [Tue May 18 01:44:57 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:57.652246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:57.652772 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:57.659912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.660401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.661177 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:57.661619 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:57.723407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-eff5bf29-440f-43ad-8262-d9c7c824bfad tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932" status: 200 len: 194 microversion: 2.1 time: 0.074905 May 18 01:44:57.723974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 399/836] 10.222.0.16 () {58 vars in 1413 bytes} [Tue May 18 01:44:57 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:44:58.532422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:58.533055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:58.540289 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:58.540836 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:58.541598 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:58.542033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:58.733926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:58.742985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:58.744527 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:44:58.745653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bfb1892f-00c5-41e5-8f7c-c22c3d299cb3 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1664 microversion: 2.20 time: 0.217059 May 18 01:44:58.746194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 438/837] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:58 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1664 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:44:58.763439 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa78765-dd53-4ceb-928d-b83fcafd6e61"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:58.764634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:58.771800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:58.772251 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:58.773180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:58.773615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.191932 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-11610b6e-6589-4fcd-a901-5d4a14d18fb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432285 May 18 01:44:59.192588 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 400/838] 10.222.0.16 () {62 vars in 1364 bytes} [Tue May 18 01:44:58 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 01:44:59.227125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "549686ef-a54b-4857-a46f-c90ca9ac9e9f"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:59.228263 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:59.235454 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.235910 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.236718 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.237154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.297416 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:59.297910 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:59.306029 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.306485 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.307257 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.307690 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.611885 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-07e10460-bb1f-4128-b5bb-57f7f78d4d74 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388839 May 18 01:44:59.612683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 439/839] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:44:59 2021] POST /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:44:59.621323 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-c022f371-49db-475a-8c3d-6138866421a7 req-78a0e4b2-5162-421d-8460-de74bdc7286b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "name": "network-vif-unplugged", "status": "completed", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:59.623710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:44:59.623710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:44:59.633849 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-c022f371-49db-475a-8c3d-6138866421a7 req-78a0e4b2-5162-421d-8460-de74bdc7286b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.634419 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-c022f371-49db-475a-8c3d-6138866421a7 req-78a0e4b2-5162-421d-8460-de74bdc7286b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.655971 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.compute.server_external_events [req-c022f371-49db-475a-8c3d-6138866421a7 req-78a0e4b2-5162-421d-8460-de74bdc7286b service nova] Unable to find a host for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47. Dropping event network-vif-unplugged {{(pid=92949) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 18 01:44:59.657053 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-c022f371-49db-475a-8c3d-6138866421a7 req-78a0e4b2-5162-421d-8460-de74bdc7286b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043190 May 18 01:44:59.658045 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 440/840] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:44:59 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 01:44:59.696490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8bf49179-fa39-493b-aab8-cbc564cb0f47 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-volume_attachments/4aa78765-dd53-4ceb-928d-b83fcafd6e61" status: 202 len: 0 microversion: 2.20 time: 0.402758 May 18 01:44:59.697313 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 401/841] 10.222.0.16 () {60 vars in 1457 bytes} [Tue May 18 01:44:59 2021] DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/os-volume_attachments/4aa78765-dd53-4ceb-928d-b83fcafd6e61 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 01:44:59.805287 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:44:59.805974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:59.813125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.813581 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.814358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.814798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.959218 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-12159f0f-6e56-43b2-8a4c-0d0b48379b6e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action" status: 202 len: 0 microversion: 2.20 time: 0.157883 May 18 01:44:59.959760 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 441/842] 10.222.0.16 () {62 vars in 1319 bytes} [Tue May 18 01:44:59 2021] POST /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 01:44:59.968521 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:44:59.969401 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:44:59.977876 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.978415 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:44:59.979390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:44:59.980054 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:00.177546 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:00.186816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:00.188934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:00.190091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c8ff7eac-2e95-42e4-b0c6-8a284e39e1b8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1672 microversion: 2.20 time: 0.225828 May 18 01:45:00.190719 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 402/843] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:44:59 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1672 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:01.208323 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:01.209246 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:01.217554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:01.218013 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:01.218799 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:01.219259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:01.622301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:01.631051 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:01.633746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:01.634894 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-76753eaf-fbe7-48ce-9dbd-da13c5436cb7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.430484 May 18 01:45:01.635458 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 442/844] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:01 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:02.654425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:02.655673 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:02.665368 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:02.666121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:02.667007 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:02.667542 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:02.904012 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:02.913298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:02.914794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:02.915960 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6de22937-e4ea-4b34-b63c-7cbb920e4d85 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.266026 May 18 01:45:02.924373 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 403/845] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:02 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:03.935079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:03.935724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:03.943530 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:03.943982 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:03.945680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:03.946136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:04.168000 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:04.177158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:04.178683 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:04.180400 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-beaffd3f-97eb-4af9-b905-76441e11e248 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.249087 May 18 01:45:04.181161 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 443/846] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:03 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:05.200222 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:05.201755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:05.210310 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:05.211285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:05.212376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:05.213462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:05.436234 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:05.445486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:05.447016 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:05.448171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-79795fd3-1749-4501-8753-edf8a537c2de tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.252740 May 18 01:45:05.458613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 404/847] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:05 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:06.467180 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:06.468077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:06.477166 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:06.477915 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:06.478712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:06.479324 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:06.708670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:06.720711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:06.722253 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:06.723417 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6ce551fd-8804-4ca9-bf6d-92094d705682 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.260386 May 18 01:45:06.724310 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 444/848] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:06 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:07.742184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:07.742800 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:07.750412 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:07.750854 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:07.751614 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:07.752050 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:07.961338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:07.970601 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:07.972113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:07.973277 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-79c0636a-fae4-4dda-b544-2f558335a747 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.235525 May 18 01:45:07.973859 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 405/849] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:07 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:08.996562 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:08.997389 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:09.008240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:09.008946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:09.009793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:09.010239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:09.226743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:09.237672 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:09.239190 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:09.240350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9b5d68f3-531a-495c-998b-041920324448 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.247680 May 18 01:45:09.241859 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 445/850] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:08 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:10.259838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:10.260526 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:10.267840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:10.268312 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:10.269106 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:10.269548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:10.477432 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:10.487914 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:10.489531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:10.490731 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-dd50fb0a-0d11-4a76-a795-522991ae3d4e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.235359 May 18 01:45:10.491362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 406/851] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:10 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:11.510780 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:11.511428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:11.518670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:11.519121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:11.519891 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:11.520354 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:11.742574 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:11.751116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:11.752659 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:11.753789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8ab4ad81-bdec-4133-83a2-b14832807161 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.247370 May 18 01:45:11.754358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 446/852] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:11 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:12.772557 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:12.774073 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:12.781561 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:12.782023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:12.782804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:12.783247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:13.002125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:13.011363 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:13.013078 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:13.014227 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-75b29cfb-53e9-4281-bbaa-7de8af1312ef tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.245511 May 18 01:45:13.014922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 407/853] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:12 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:14.032730 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:14.033353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:14.040881 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:14.041343 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:14.042953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:14.043531 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:14.238383 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:14.246973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:14.248534 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:14.249670 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6578e48c-e9ff-49e5-8a12-2917178ab790 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.221451 May 18 01:45:14.250233 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 447/854] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:14 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:15.270756 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:15.271364 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:15.280314 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:15.280797 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:15.281587 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:15.282028 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:15.479174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:15.487832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:15.489371 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:15.490489 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4ba03a5d-bdc4-4bb8-abe5-a55a351c82d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.225858 May 18 01:45:15.491034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 408/855] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:15 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:16.312914 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:16.313839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:16.321381 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.321845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.322625 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.323069 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.387766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-183bcea6-1e2f-4465-b007-f7258db2fc16 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078635 May 18 01:45:16.388353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 448/856] 10.222.0.16 () {58 vars in 1302 bytes} [Tue May 18 01:45:16 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:16.508470 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:16.509082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:16.516413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.516812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.517591 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.518055 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.625567 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:16.626068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:16.633655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.634109 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.634889 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.635344 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.698077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b4816444-d012-4d51-9b9c-22e1e5c01054 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932" status: 200 len: 194 microversion: 2.1 time: 0.076307 May 18 01:45:16.698677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 449/857] 10.222.0.16 () {58 vars in 1413 bytes} [Tue May 18 01:45:16 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:45:16.707922 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:16.708477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:16.717338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.717798 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.718575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:16.719111 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:16.719563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:16.728906 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:16.730405 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:16.731519 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9bcfe49a-13ea-419b-b86a-04165fb0383b tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.226817 May 18 01:45:16.732071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 409/858] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:16 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:16.877830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lazy-loading 'services' on Instance uuid 4a643178-61ea-4a22-8f16-4af570d863e2 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:45:17.019280 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d68ac4f8-fc4b-4504-be23-3900459723f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932" status: 202 len: 0 microversion: 2.1 time: 0.314798 May 18 01:45:17.019971 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 450/859] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:45:16 2021] DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/3e54abfc-e559-46c6-90b9-effdb3e3a932 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:45:17.749548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:17.750260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:17.758247 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:17.758702 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:17.759486 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:17.759923 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:17.950091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:17.958860 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:17.960846 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:17.961988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-af64a99a-fee9-4247-b19c-967b9b5d8d74 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.216207 May 18 01:45:17.962544 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 410/860] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:17 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:18.981395 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:18.982099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:18.989734 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:18.990191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:18.990959 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:18.991914 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.186110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:19.195623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:19.197307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:19.198443 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cfd153fc-9e48-4152-970d-f5bf8105b8ff tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.221349 May 18 01:45:19.199007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 451/861] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:18 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 01:45:19.315529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:19.316075 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:19.323840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:19.324289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.325079 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:19.325512 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.391209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5579b4ac-5cf9-4114-a56d-503627347bc0 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/549686ef-a54b-4857-a46f-c90ca9ac9e9f" status: 200 len: 194 microversion: 2.1 time: 0.080287 May 18 01:45:19.391787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 411/862] 10.222.0.16 () {58 vars in 1413 bytes} [Tue May 18 01:45:19 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/549686ef-a54b-4857-a46f-c90ca9ac9e9f => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:19.401388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:19.401896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:19.409004 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:19.409464 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.410247 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:19.410690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.571835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lazy-loading 'services' on Instance uuid 4a643178-61ea-4a22-8f16-4af570d863e2 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:45:19.713091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f9085241-2e88-4ede-b9a9-c37c9b66f430 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/549686ef-a54b-4857-a46f-c90ca9ac9e9f" status: 202 len: 0 microversion: 2.1 time: 0.315375 May 18 01:45:19.714153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 452/863] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:45:19 2021] DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2/os-volume_attachments/549686ef-a54b-4857-a46f-c90ca9ac9e9f => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:45:19.724354 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-a1cc62a8-f754-46ad-928d-458896ac2a55 req-a5e7c71a-9145-42bb-9e8c-9c437f867396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "name": "network-vif-plugged", "status": "completed", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:19.727379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:45:19.727379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:45:19.738605 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a1cc62a8-f754-46ad-928d-458896ac2a55 req-a5e7c71a-9145-42bb-9e8c-9c437f867396 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:19.739090 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a1cc62a8-f754-46ad-928d-458896ac2a55 req-a5e7c71a-9145-42bb-9e8c-9c437f867396 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:19.758403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-a1cc62a8-f754-46ad-928d-458896ac2a55 req-a5e7c71a-9145-42bb-9e8c-9c437f867396 service nova] Creating event network-vif-plugged:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:45:19.763396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-a1cc62a8-f754-46ad-928d-458896ac2a55 req-a5e7c71a-9145-42bb-9e8c-9c437f867396 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042625 May 18 01:45:19.764647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 412/864] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:20.219266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:20.219962 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:20.227905 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:20.228382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:20.229190 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:20.229624 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:20.431367 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:20.440446 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:20.442116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:20.443297 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a5a1cd9f-8142-4f07-b705-bca51e22b5bc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.228730 May 18 01:45:20.443926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 453/865] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:20 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:21.302345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:21.303022 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:21.311528 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.312161 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.313072 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.313464 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.379268 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:45:21.420628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:21.421227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:21.428410 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.430038 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.430897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.431411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.489122 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lazy-loading 'flavor' on Instance uuid dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:45:21.500845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-784b3236-f68e-42c1-b3f6-d277d56db9d3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 204 len: 0 microversion: 2.1 time: 0.202509 May 18 01:45:21.501520 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 413/866] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:45:21 2021] DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:45:21.511270 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:21.511966 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:21.519379 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.519827 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.520644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.521105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.639684 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9c71fcce-3e12-44cd-b15c-2d4424280bc9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "POST /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451/action" status: 202 len: 0 microversion: 2.1 time: 0.222465 May 18 01:45:21.640189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 454/867] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:45:21 2021] POST /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:45:21.645543 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:21.646245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:21.653791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.654243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.655023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.655461 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.799820 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:21.809595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:21.811120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:21.812254 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6b27640d-e39a-41a0-998b-3d8d0024a6f5 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1730 microversion: 2.20 time: 0.306110 May 18 01:45:21.824883 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 414/868] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:21 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:21.824883 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:21.824883 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:21.825498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.825956 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.826763 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:21.827198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:21.884996 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:21.893439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d3a9a019-beee-4a4c-8e0a-cb9cf2439e76 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1671 microversion: 2.1 time: 0.251763 May 18 01:45:21.893956 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 455/869] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:21 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:22.031124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:22.040393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f3bfe529-0fa7-4ea5-89dc-374fa58ab478 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.226562 May 18 01:45:22.040959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 415/870] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:21 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:22.831605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:22.832216 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:22.840724 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:22.841183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:22.841966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:22.842405 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:22.910763 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:22.911377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:22.919712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:22.920170 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:22.921255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:22.921696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:23.089314 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:23.098131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:23.099676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:23.100862 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-91ac092e-f0b4-4efa-b605-16909bfe9ae7 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1717 microversion: 2.20 time: 0.273088 May 18 01:45:23.101469 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 456/871] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:22 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1717 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:23.106573 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:23.107535 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:23.116261 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:23.116970 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:23.118101 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:23.118768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:23.161300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:23.169398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e8c867f1-26a9-4118-8973-8a8ec6285f72 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1671 microversion: 2.1 time: 0.262308 May 18 01:45:23.169980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 416/872] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:22 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:45:23.362338 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:23.371131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2b98f774-6ac0-403b-aa5d-02f0a26adfcd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.268341 May 18 01:45:23.371887 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 457/873] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:23 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:24.186951 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:24.187606 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:24.195737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:24.196361 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:24.197212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:24.197596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:24.387623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:24.388173 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:24.395515 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:24.395969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:24.396789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:24.397231 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:24.413406 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2bb1ad3b4340dd95a7ac5157c55f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ea4c0034a4318bdae3a2b20926927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:24.422579 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-021ea249-625d-48ac-bd24-30995f2e5305 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 200 len: 1603 microversion: 2.1 time: 0.239418 May 18 01:45:24.423608 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 417/874] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:24 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:24.843014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-9764af2c-f27a-42e2-a32b-0b4990a3c434 req-c8b02355-1581-445f-b7a6-d2ba0d454429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a643178-61ea-4a22-8f16-4af570d863e2", "name": "network-vif-deleted", "tag": "8f6dc203-9fc5-4a53-b523-347e7a553ff4"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:24.845081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:45:24.845081 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:45:24.858954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-9764af2c-f27a-42e2-a32b-0b4990a3c434 req-c8b02355-1581-445f-b7a6-d2ba0d454429 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:24.858954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-9764af2c-f27a-42e2-a32b-0b4990a3c434 req-c8b02355-1581-445f-b7a6-d2ba0d454429 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:24.864256 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:24.874841 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-028fac65-c347-4746-bdfd-c5b7508a82a6 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.490884 May 18 01:45:24.875838 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 458/875] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:24 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:45:24.897817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-9764af2c-f27a-42e2-a32b-0b4990a3c434 req-c8b02355-1581-445f-b7a6-d2ba0d454429 service nova] Creating event network-vif-deleted:8f6dc203-9fc5-4a53-b523-347e7a553ff4 for instance 4a643178-61ea-4a22-8f16-4af570d863e2 on hv-cinder-78462 May 18 01:45:24.904812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-9764af2c-f27a-42e2-a32b-0b4990a3c434 req-c8b02355-1581-445f-b7a6-d2ba0d454429 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065747 May 18 01:45:24.905413 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 418/876] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:45:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:25.441182 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:25.442079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:25.451701 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:25.452424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:25.453251 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:25.453685 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:25.506594 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. May 18 01:45:25.507191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:45:25.508117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-58f88cbc-a7c2-4014-a019-10742f4b1a50 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 404 len: 111 microversion: 2.1 time: 0.070922 May 18 01:45:25.509033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 459/877] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:25 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:45:25.517918 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-853ad331-1f8d-459d-8e0f-5094ce219b28 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '.version_select at 0x7efcd8ec64c0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:25.537320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-853ad331-1f8d-459d-8e0f-5094ce219b28 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743728704" status: 202 len: 0 microversion: 2.1 time: 0.023338 May 18 01:45:25.537904 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 419/878] 10.222.0.16 () {58 vars in 1218 bytes} [Tue May 18 01:45:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743728704 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:45:25.894854 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:25.895778 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:25.904583 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:25.905235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:25.906117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:25.906674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:26.344179 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:26.353196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-474ecb34-2650-4402-858c-2f0eb8bf8b0e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.462071 May 18 01:45:26.363085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 460/879] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:25 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:27.370463 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:27.371239 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:27.378604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:27.379053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:27.379816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:27.380250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:27.589065 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:27.597565 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8ac368d7-5bbb-46a8-9268-86381ebc6942 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.230811 May 18 01:45:27.598141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 420/880] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:27 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:28.619198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:28.619759 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:28.627228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:28.627688 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:28.628509 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:28.628994 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:28.823919 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:28.832123 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8b074b76-07ee-47f1-ae81-ab44895535e4 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.217590 May 18 01:45:28.832723 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 461/881] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:28 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:29.190989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:29.191492 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:29.199171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.199633 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:29.200431 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.200874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:29.248841 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. May 18 01:45:29.249370 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:45:29.250186 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-84bb73b2-c76d-403f-90e1-ba49aeb1b634 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 404 len: 111 microversion: 2.1 time: 0.062932 May 18 01:45:29.250720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 421/882] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:45:29 2021] DELETE /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:45:29.258946 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:29.259554 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 4a643178-61ea-4a22-8f16-4af570d863e2] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:29.266693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.267141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:29.267907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.268368 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:29.315740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. May 18 01:45:29.316356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 4a643178-61ea-4a22-8f16-4af570d863e2 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:45:29.317196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e9bae072-b4f7-4688-a6dc-c0376cbe54f3 tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2" status: 404 len: 111 microversion: 2.1 time: 0.062518 May 18 01:45:29.317733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 462/883] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:29 2021] GET /compute/v2.1/servers/4a643178-61ea-4a22-8f16-4af570d863e2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:45:29.849920 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:29.850531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:29.858164 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.858612 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:29.859381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:29.859812 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:30.052747 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:30.061687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b6a52dcb-ae52-432c-89af-0dacf8561819 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.215487 May 18 01:45:30.062249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 422/884] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:29 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:30.547963 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:30.548498 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:30.555987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:30.556426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:30.557211 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:30.557653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:30.606079 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. May 18 01:45:30.606677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:45:30.607505 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-61144171-a51d-4cd6-810b-c7913db8e93e tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 404 len: 111 microversion: 2.1 time: 0.063306 May 18 01:45:30.608042 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 463/885] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:45:30 2021] DELETE /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:45:30.615824 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:30.616500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] [instance: 5ba23ab8-adff-42c4-8703-96301fb86d53] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:30.623634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:30.624091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:30.624905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:30.625349 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:30.673189 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] HTTP exception thrown: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. May 18 01:45:30.673786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] Returning 404 to user: Instance 5ba23ab8-adff-42c4-8703-96301fb86d53 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:45:30.674600 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d2f40581-f126-4b52-b654-b87736ab724c tempest-AttachVolumeTestJSON-1501737572 tempest-AttachVolumeTestJSON-1501737572-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53" status: 404 len: 111 microversion: 2.1 time: 0.062490 May 18 01:45:30.675120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 423/886] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:30 2021] GET /compute/v2.1/servers/5ba23ab8-adff-42c4-8703-96301fb86d53 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:45:31.078715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:31.079365 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:31.087278 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:31.087749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:31.088572 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:31.089018 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:31.287428 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:31.296244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-8a7011ef-5662-4da6-9514-fb1e77db2ce9 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.221254 May 18 01:45:31.296960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 464/887] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:31 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:32.314082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:32.314637 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:32.323185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:32.323720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:32.324550 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:32.325049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:32.678694 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:32.687794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5982a1a5-b4bb-4038-a732-9ba7455a074f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.377558 May 18 01:45:32.688386 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 424/888] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:32 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:33.705795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:33.706431 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:33.714969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:33.715430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:33.716220 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:33.716953 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:33.923127 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:33.934309 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-91824e9d-306a-4c4b-9249-414770940b62 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.232458 May 18 01:45:33.935225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 465/889] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:33 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:34.951393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:34.952000 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:34.961842 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:34.963134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:34.964166 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:34.964685 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:35.192728 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:35.201575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-15892e5b-baa6-4ade-832e-f1fd5eeeb5bf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1567 microversion: 2.1 time: 0.254267 May 18 01:45:35.202181 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 425/890] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:34 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:35.218244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:35.218955 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:35.227164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:35.227698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:35.228506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:35.229080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:35.389897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-28234137-4ba9-484b-bf0a-f27d28236475 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "POST /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451/action" status: 202 len: 0 microversion: 2.1 time: 0.175245 May 18 01:45:35.393955 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 466/891] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:45:35 2021] POST /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:45:35.399218 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:35.399866 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:35.409456 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:35.409989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:35.410998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:35.411630 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:35.818483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:35.829109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6964867a-6f55-43a0-bcd8-36431cfffa68 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1515 microversion: 2.1 time: 0.433613 May 18 01:45:35.839506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 426/892] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:35 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:36.846875 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:36.847692 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:36.855238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:36.855752 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:36.856658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:36.857100 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:37.065384 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:37.076435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7988b783-c8ec-4c9f-ba65-172c4f87d96f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1517 microversion: 2.1 time: 0.233151 May 18 01:45:37.077131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 467/893] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:36 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:37.697782 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-da70546d-c78b-48aa-b197-8c1b8bef591a req-f6336d8d-e825-4782-98aa-08bb4c2a90ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "name": "network-vif-unplugged", "status": "completed", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:37.699684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:45:37.699684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:45:37.711787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-da70546d-c78b-48aa-b197-8c1b8bef591a req-f6336d8d-e825-4782-98aa-08bb4c2a90ff service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:37.712700 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-da70546d-c78b-48aa-b197-8c1b8bef591a req-f6336d8d-e825-4782-98aa-08bb4c2a90ff service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:37.738764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-da70546d-c78b-48aa-b197-8c1b8bef591a req-f6336d8d-e825-4782-98aa-08bb4c2a90ff service nova] Creating event network-vif-unplugged:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:45:37.746113 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-da70546d-c78b-48aa-b197-8c1b8bef591a req-f6336d8d-e825-4782-98aa-08bb4c2a90ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054229 May 18 01:45:37.747663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 427/894] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:38.094191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:38.094805 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:38.102490 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:38.102941 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:38.103820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:38.104260 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:38.342830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:38.351901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-211a67b2-952f-4935-9c3e-e90bc922bc36 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.260888 May 18 01:45:38.352717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 468/895] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:38 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:39.369958 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:39.370710 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:39.378224 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:39.378682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:39.379449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:39.380086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:39.608266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:39.616806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8ed67386-7923-4fc7-96e9-64b201de11f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.251262 May 18 01:45:39.617695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 428/896] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:39 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:40.634703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:40.635351 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:40.642577 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:40.643065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:40.643847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:40.644293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:40.845770 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:40.853913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-294aefd2-a8f7-4869-8324-e5e612e24d3b tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.223539 May 18 01:45:40.854479 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 469/897] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:40 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:41.871010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:41.871626 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:41.878882 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:41.879329 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:41.880087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:41.880571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:42.163590 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:42.172834 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3ef41306-0a41-428c-a9ff-0219367ca249 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.306329 May 18 01:45:42.173403 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 429/898] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:41 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:43.189857 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:43.190503 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:43.198354 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:43.198803 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:43.199568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:43.200001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:43.391184 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:43.399679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e4126e62-aac7-44fe-a87d-fe1e21f8b78a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.213492 May 18 01:45:43.400251 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 470/899] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:43 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:44.416644 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:44.417293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:44.424787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:44.425318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:44.426306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:44.426919 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:44.635091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:44.643178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-01bb1f48-4979-49b6-ac7a-273c2dd2520f tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1573 microversion: 2.1 time: 0.230492 May 18 01:45:44.643744 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 430/900] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:44 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:45.662442 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:45.663244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:45.672164 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:45.672413 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:45.673202 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:45.673780 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:45.887799 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:45.896689 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d1a1c76d-7c47-4658-a035-3ccac5670420 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1560 microversion: 2.1 time: 0.237837 May 18 01:45:45.897149 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 471/901] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:45:45 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:45:47.776759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-7ad70d46-fffe-42fa-9231-9a3b5f47db18 req-ec052f11-2545-438a-918f-e5b21230d293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "name": "network-vif-plugged", "status": "completed", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:47.778488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:45:47.778488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:45:47.787901 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-7ad70d46-fffe-42fa-9231-9a3b5f47db18 req-ec052f11-2545-438a-918f-e5b21230d293 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:47.788458 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-7ad70d46-fffe-42fa-9231-9a3b5f47db18 req-ec052f11-2545-438a-918f-e5b21230d293 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:47.806293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-7ad70d46-fffe-42fa-9231-9a3b5f47db18 req-ec052f11-2545-438a-918f-e5b21230d293 service nova] Creating event network-vif-plugged:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:45:47.811279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-7ad70d46-fffe-42fa-9231-9a3b5f47db18 req-ec052f11-2545-438a-918f-e5b21230d293 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038854 May 18 01:45:47.812209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 431/902] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:45:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:45:55.873210 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:55.873729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:55.880911 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:55.881369 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:55.882149 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:55.882632 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:55.943463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:45:56.056080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-dd5e4283-4e88-4da6-9da2-3e5cd886e6f1 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 204 len: 0 microversion: 2.20 time: 0.186985 May 18 01:45:56.058563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 472/903] 10.222.0.16 () {60 vars in 1280 bytes} [Tue May 18 01:45:55 2021] DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 01:45:56.067437 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:56.068127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:56.075786 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:56.076237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:56.077115 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:56.077477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:56.351516 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:56.362350 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:56.364673 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:56.365867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f3e0a5d7-f626-4509-b22f-bf47ccaa37d2 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.302924 May 18 01:45:56.366487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 432/904] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:56 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:57.384943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:57.386159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:57.393520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:57.393974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:57.394751 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:57.395184 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:57.707158 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:57.717558 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:57.719147 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:57.720582 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6de61ea6-8082-41d7-a26f-db3a21f02ecc tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1723 microversion: 2.20 time: 0.339682 May 18 01:45:57.721112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 473/905] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:57 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:58.739141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:45:58.739854 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:45:58.753400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:58.753857 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:58.754647 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:58.755087 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:58.973174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:58.973623 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-2d2e50c9-7eb5-4496-b9ca-17934d44f727 req-fdf9095a-2512-4d57-9eb5-7465bd3a7bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47", "name": "network-vif-deleted", "tag": "74e57cd3-5eae-459a-a22e-0cddc9e6a5da"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:45:58.975740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:45:58.975740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:45:58.985260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:58.986781 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2014d2cedb4d80a7586413365c2a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a135b6f60458080f4d5d86c5f22b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:45:58.990477 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2d2e50c9-7eb5-4496-b9ca-17934d44f727 req-fdf9095a-2512-4d57-9eb5-7465bd3a7bc1 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:45:58.990929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ac05bc10-46f9-4727-84c0-610b902341c4 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 200 len: 1655 microversion: 2.20 time: 0.255757 May 18 01:45:58.991513 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 433/906] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:45:58 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 1655 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 01:45:58.995298 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2d2e50c9-7eb5-4496-b9ca-17934d44f727 req-fdf9095a-2512-4d57-9eb5-7465bd3a7bc1 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:45:59.031207 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-2d2e50c9-7eb5-4496-b9ca-17934d44f727 req-fdf9095a-2512-4d57-9eb5-7465bd3a7bc1 service nova] Creating event network-vif-deleted:74e57cd3-5eae-459a-a22e-0cddc9e6a5da for instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 on hv-cinder-78462 May 18 01:45:59.037649 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-2d2e50c9-7eb5-4496-b9ca-17934d44f727 req-fdf9095a-2512-4d57-9eb5-7465bd3a7bc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067780 May 18 01:45:59.038928 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 474/907] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:45:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:00.011466 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:00.012175 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:00.019764 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:00.020215 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:00.021071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:00.021515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:00.075718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. May 18 01:46:00.076327 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:00.077171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a9c526f2-270b-49e6-b910-195a48b3e392 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 404 len: 111 microversion: 2.20 time: 0.070286 May 18 01:46:00.077980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 434/908] 10.222.0.16 () {60 vars in 1277 bytes} [Tue May 18 01:46:00 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 01:46:00.086715 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3fa093b1-17fb-44a2-b0a9-560204fd91d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '.version_select at 0x7efcd96a7af0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:00.090062 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fa093b1-17fb-44a2-b0a9-560204fd91d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [5099a07f-862e-4820-8945-a107d7da3a22] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 18 01:46:01.108391 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fa093b1-17fb-44a2-b0a9-560204fd91d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [5099a07f-862e-4820-8945-a107d7da3a22] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48212. May 18 01:46:01.126949 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3fa093b1-17fb-44a2-b0a9-560204fd91d8 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852095402" status: 204 len: 0 microversion: 2.20 time: 1.044569 May 18 01:46:01.127533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 475/909] 10.222.0.16 () {60 vars in 1259 bytes} [Tue May 18 01:46:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852095402 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 01:46:06.692070 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:06.692599 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:06.700687 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:06.701233 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:06.702086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:06.702546 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:06.751861 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. May 18 01:46:06.752499 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:06.753338 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b2b0e4a8-c35b-4f3e-80f9-77349092538e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 404 len: 111 microversion: 2.1 time: 0.064973 May 18 01:46:06.753904 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 435/910] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:46:06 2021] DELETE /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:06.762337 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:06.763209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:06.770894 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:06.771352 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:06.772129 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:06.772606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:06.821584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. May 18 01:46:06.822194 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:06.823927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6d779671-4cd7-4bb0-8278-34e8ae1645fa tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47" status: 404 len: 111 microversion: 2.1 time: 0.065803 May 18 01:46:06.824521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 476/911] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:06 2021] GET /compute/v2.1/servers/acd53c28-bb9f-42ca-a5b9-4f1a8e4b7d47 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:08.063178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:08.063681 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:08.070848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:08.071295 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:08.072086 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:08.072582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:08.121515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. May 18 01:46:08.122098 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:08.122912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-982150cf-c964-4c89-94ae-aa88e1586e1e tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 404 len: 111 microversion: 2.1 time: 0.063473 May 18 01:46:08.123435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 436/912] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:46:08 2021] DELETE /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:08.131286 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:08.131903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] [instance: 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:08.139307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:08.139758 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:08.140569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:08.141007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:08.191426 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] HTTP exception thrown: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. May 18 01:46:08.192016 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] Returning 404 to user: Instance 33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:08.192858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b0b834bb-06e0-421e-839b-7e16d31daf94 tempest-AttachVolumeShelveTestJSON-930465296 tempest-AttachVolumeShelveTestJSON-930465296-project] 10.222.0.16 "GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3" status: 404 len: 111 microversion: 2.1 time: 0.065415 May 18 01:46:08.193392 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 477/913] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:08 2021] GET /compute/v2.1/servers/33fd4dc3-dae6-4b7d-86e2-cf886eadcaf3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:16.133912 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-4662e6f3-09d6-453e-bec8-dc73ce37eac3 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd900db80>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:16.222331 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-4662e6f3-09d6-453e-bec8-dc73ce37eac3 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24bb8a60-ed82-4630-b0bf-1e564c1fcdeb" status: 200 len: 350 microversion: 2.1 time: 0.091974 May 18 01:46:16.222898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 437/914] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:46:16 2021] GET /compute/v2.1/os-volumes/24bb8a60-ed82-4630-b0bf-1e564c1fcdeb => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:17.709302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d03be818-3fc1-4098-9121-f52763802afa tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd96a7af0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:17.806364 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d03be818-3fc1-4098-9121-f52763802afa tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fbff4889-7b84-4089-ac87-87cc63703c2d" status: 200 len: 350 microversion: 2.1 time: 0.100611 May 18 01:46:17.807679 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 478/915] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:46:17 2021] GET /compute/v2.1/os-volumes/fbff4889-7b84-4089-ac87-87cc63703c2d => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:19.292878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-626ba59a-50b3-45ac-9fc4-7f74aa1b69b6 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd9010160>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.383105 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-626ba59a-50b3-45ac-9fc4-7f74aa1b69b6 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a0c76632-04f9-455f-8bf1-cbcedd9a6422" status: 200 len: 351 microversion: 2.1 time: 0.094445 May 18 01:46:19.383670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 438/916] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes/a0c76632-04f9-455f-8bf1-cbcedd9a6422 => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:19.394584 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bcfcff15-e8ae-4ea7-a424-a04efdb90b13 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcda11bb80>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.481279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bcfcff15-e8ae-4ea7-a424-a04efdb90b13 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090206 May 18 01:46:19.481868 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 479/917] 10.222.0.16 () {58 vars in 1134 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:19.493632 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e3ed0815-fe30-4d24-b745-19f03da4ed41 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd9010b80>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.573225 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e3ed0815-fe30-4d24-b745-19f03da4ed41 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083104 May 18 01:46:19.573787 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 439/918] 10.222.0.16 () {58 vars in 1149 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:19.585422 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-7ece896f-33ad-461e-89a3-e29cda46d9ed tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd9698dc0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.676189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-7ece896f-33ad-461e-89a3-e29cda46d9ed tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094474 May 18 01:46:19.677022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 480/919] 10.222.0.16 () {58 vars in 1134 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:19.687630 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0b477a25-567b-41ba-96ef-0e78905a171a tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcda0919d0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.767517 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0b477a25-567b-41ba-96ef-0e78905a171a tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083348 May 18 01:46:19.768155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 440/920] 10.222.0.16 () {58 vars in 1167 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:19.780589 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ee5769e4-5032-4627-8257-70c24ac8c733 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd96989d0>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.862938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ee5769e4-5032-4627-8257-70c24ac8c733 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086939 May 18 01:46:19.863544 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 481/921] 10.222.0.16 () {58 vars in 1170 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:19.875641 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c46c2807-c9c3-4a77-a4c0-9cd1f5242aff tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd9010ee0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:19.958905 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c46c2807-c9c3-4a77-a4c0-9cd1f5242aff tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086826 May 18 01:46:19.959550 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 441/922] 10.222.0.16 () {58 vars in 1155 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:19.971308 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-71f570fa-f10c-4920-8344-0fec0c4e11b7 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcda010430>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:20.049659 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-71f570fa-f10c-4920-8344-0fec0c4e11b7 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081828 May 18 01:46:20.050234 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 482/923] 10.222.0.16 () {58 vars in 1188 bytes} [Tue May 18 01:46:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:20.062120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9278b499-0177-4319-b8e4-ef83eb75a9b6 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] Calling method '.version_select at 0x7efcd8ec6e50>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:20.143727 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9278b499-0177-4319-b8e4-ef83eb75a9b6 tempest-VolumesTestJSON-1384517679 tempest-VolumesTestJSON-1384517679-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085278 May 18 01:46:20.144329 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 442/924] 10.222.0.16 () {58 vars in 1155 bytes} [Tue May 18 01:46:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:25.353085 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5e4b92e1-4576-480c-a194-5c9bd9e94dbd tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Action: 'create', calling method: .version_select at 0x7efcd96a70d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2132461471", "metadata": {"Type": "work"}}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:25.355627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-5e4b92e1-4576-480c-a194-5c9bd9e94dbd tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.356467 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-5e4b92e1-4576-480c-a194-5c9bd9e94dbd tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124192 May 18 01:46:25.357000 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 483/925] 10.222.0.16 () {60 vars in 1156 bytes} [Tue May 18 01:46:25 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 18 01:46:25.366071 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-05c14197-cdcc-4977-8fba-7cfc372552a5 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Action: 'create', calling method: .version_select at 0x7efcd8d6ea60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1441661678", "metadata": {"Type": "work"}}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:25.367498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-05c14197-cdcc-4977-8fba-7cfc372552a5 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.368285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-05c14197-cdcc-4977-8fba-7cfc372552a5 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006062 May 18 01:46:25.368825 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 443/926] 10.222.0.16 () {60 vars in 1156 bytes} [Tue May 18 01:46:25 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 01:46:25.378637 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f6653028-fa00-4b1c-8f4d-226a1ba56dc2 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Action: 'create', calling method: .version_select at 0x7efcda0ff670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-718134936", "metadata": {"Type": "work"}}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:25.379801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f6653028-fa00-4b1c-8f4d-226a1ba56dc2 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.380607 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f6653028-fa00-4b1c-8f4d-226a1ba56dc2 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006847 May 18 01:46:25.381114 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 484/927] 10.222.0.16 () {60 vars in 1156 bytes} [Tue May 18 01:46:25 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 01:46:25.390286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5f78c5b5-ab71-4fc6-8d30-9bba31ba8585 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Calling method '.version_select at 0x7efcd9010670>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:25.449025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-5f78c5b5-ab71-4fc6-8d30-9bba31ba8585 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] HTTP exception thrown: Volume tempest-invalid-1211348219 could not be found. May 18 01:46:25.449618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5f78c5b5-ab71-4fc6-8d30-9bba31ba8585 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 404 to user: Volume tempest-invalid-1211348219 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.450431 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5f78c5b5-ab71-4fc6-8d30-9bba31ba8585 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1211348219" status: 404 len: 99 microversion: 2.1 time: 0.063858 May 18 01:46:25.451618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 444/928] 10.222.0.16 () {58 vars in 1218 bytes} [Tue May 18 01:46:25 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1211348219 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 18 01:46:25.464269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bb8eae29-a4db-4fd7-9230-2fd94637d677 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005483 May 18 01:46:25.465227 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 485/929] 10.222.0.16 () {58 vars in 1140 bytes} [Tue May 18 01:46:25 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 01:46:25.473606 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-25b03b98-35fc-453c-aadd-987677a1df41 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003612 May 18 01:46:25.474103 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 445/930] 10.222.0.16 () {58 vars in 1137 bytes} [Tue May 18 01:46:25 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 18 01:46:25.484749 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e1c89ff2-32aa-415e-89d8-5616c1496604 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Calling method '.version_select at 0x7efcda010d30>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:25.548184 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-e1c89ff2-32aa-415e-89d8-5616c1496604 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] HTTP exception thrown: Volume 0aa52630-ab48-4f59-b7a5-7e2e81993d66 could not be found. May 18 01:46:25.548974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e1c89ff2-32aa-415e-89d8-5616c1496604 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 404 to user: Volume 0aa52630-ab48-4f59-b7a5-7e2e81993d66 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.549802 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e1c89ff2-32aa-415e-89d8-5616c1496604 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0aa52630-ab48-4f59-b7a5-7e2e81993d66" status: 404 len: 109 microversion: 2.1 time: 0.068757 May 18 01:46:25.550354 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 486/931] 10.222.0.16 () {58 vars in 1248 bytes} [Tue May 18 01:46:25 2021] DELETE /compute/v2.1/os-volumes/0aa52630-ab48-4f59-b7a5-7e2e81993d66 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:25.560323 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a61d8da8-5c75-4614-b691-026b30b78362 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Calling method '.version_select at 0x7efcd90100d0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:25.632062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-a61d8da8-5c75-4614-b691-026b30b78362 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] HTTP exception thrown: Volume dcae7b70-3530-47e4-ba73-e7ebabd01f4b could not be found. May 18 01:46:25.632398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a61d8da8-5c75-4614-b691-026b30b78362 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] Returning 404 to user: Volume dcae7b70-3530-47e4-ba73-e7ebabd01f4b could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:25.633174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a61d8da8-5c75-4614-b691-026b30b78362 tempest-VolumesNegativeTest-10535971 tempest-VolumesNegativeTest-10535971-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/dcae7b70-3530-47e4-ba73-e7ebabd01f4b" status: 404 len: 109 microversion: 2.1 time: 0.076842 May 18 01:46:25.633729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 446/932] 10.222.0.16 () {58 vars in 1245 bytes} [Tue May 18 01:46:25 2021] GET /compute/v2.1/os-volumes/dcae7b70-3530-47e4-ba73-e7ebabd01f4b => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:40.191033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:40.192149 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:40.200326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:40.201003 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:40.201801 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:40.202236 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:40.262735 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:46:40.381812 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6a467442-0321-4f79-bc3f-96b6e01f3cea tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 204 len: 0 microversion: 2.1 time: 0.194745 May 18 01:46:40.382765 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 487/933] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:46:40 2021] DELETE /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:46:40.391891 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:40.392554 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:40.401768 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:40.402515 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:40.403315 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:40.403773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:40.823288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:40.835991 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-62d59084-0eb5-49a6-b0c1-4b896d00a29a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1577 microversion: 2.1 time: 0.447850 May 18 01:46:40.848496 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 447/934] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:40 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1577 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:41.865293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:41.866302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:41.884657 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:41.886153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:41.886985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:41.887641 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:42.308535 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:42.321170 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e30b36d4-4d93-4b82-8cce-2d0075f2e781 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1577 microversion: 2.1 time: 0.469107 May 18 01:46:42.322611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 488/935] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:41 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1577 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:43.340571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:43.341199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:43.357874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:43.358592 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:43.359576 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:43.360168 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:43.716528 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:43.727745 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-35c86cd6-335b-45fb-b848-0d5dc9fa5140 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1509 microversion: 2.1 time: 0.390427 May 18 01:46:43.739244 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 448/936] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:43 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:44.144172 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-88531901-a821-4a6e-8896-cf141b0dfcd6 req-42a50b80-44c1-4339-a7c6-bbcd5d0ec793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09f17e-cba4-4ef5-9feb-b13cee531b03", "name": "network-vif-deleted", "tag": "2bdedcf4-34b1-4847-a5c3-5cacd258a734"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:44.146550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:46:44.146550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:46:44.158813 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-88531901-a821-4a6e-8896-cf141b0dfcd6 req-42a50b80-44c1-4339-a7c6-bbcd5d0ec793 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:44.160050 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-88531901-a821-4a6e-8896-cf141b0dfcd6 req-42a50b80-44c1-4339-a7c6-bbcd5d0ec793 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:44.194610 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-88531901-a821-4a6e-8896-cf141b0dfcd6 req-42a50b80-44c1-4339-a7c6-bbcd5d0ec793 service nova] Creating event network-vif-deleted:2bdedcf4-34b1-4847-a5c3-5cacd258a734 for instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 on hv-cinder-78462 May 18 01:46:44.200390 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-88531901-a821-4a6e-8896-cf141b0dfcd6 req-42a50b80-44c1-4339-a7c6-bbcd5d0ec793 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060434 May 18 01:46:44.201510 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 489/937] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:46:44.746285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:44.747708 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:44.755205 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:44.755885 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:44.756908 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:44.757724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:44.906042 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:44.937535 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-10a588f9-77f5-4c88-ad4a-37743d51da74 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1225 microversion: 2.1 time: 0.195385 May 18 01:46:44.966260 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 449/938] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:44 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:45.958191 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:45.958929 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:45.969677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:45.970528 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:45.971699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:45.972322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:46.183983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:46.202355 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6bd808ef-4a28-4d1b-be05-555768df628e tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1225 microversion: 2.1 time: 0.248441 May 18 01:46:46.212537 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 490/939] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:45 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1225 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:47.221133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:47.222498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:47.237992 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:47.239138 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:47.240934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:47.241627 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:47.772437 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:47.787878 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-66d5f5b4-163c-4727-aa66-167cfbb3767f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 200 len: 1225 microversion: 2.1 time: 0.571169 May 18 01:46:47.788773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 450/940] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:47 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 1225 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:48.805711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:48.806341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:48.813944 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:48.814407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:48.815197 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:48.815645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:48.881288 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] HTTP exception thrown: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. May 18 01:46:48.881904 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Returning 404 to user: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:46:48.883246 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-bc269abe-dd3e-4e1c-b2a6-3011b71e5efd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 404 len: 111 microversion: 2.1 time: 0.081714 May 18 01:46:48.883820 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 491/941] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:48 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:46:49.011166 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1029873003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457100581", "security_groups": [{"name": "tempest-secgroup-smoke-1203183692"}], "block_device_mapping_v2": [{"uuid": "f0b29083-095a-49ad-a8a6-46feee91265a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2192753-81de-4186-86a3-1e0d48f6a9fe"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:49.209838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] validate_networks() for [('f2192753-81de-4186-86a3-1e0d48f6a9fe', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:46:50.024364 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:46:50.025492 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:46:50.026286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:46:50.026738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:46:50.027306 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:46:50.036944 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:50.037741 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:50.038551 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:50.038988 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:50.058844 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:46:50.063684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for user 257328ddbc2b426bbcc9450bea59c08f and project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:46:50.185679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:46:50.188029 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0b29083-095a-49ad-a8a6-46feee91265a',volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:46:50.357838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [db35d3be-ee71-4307-8757-fda6c55dc912] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 18 01:46:51.382958 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [db35d3be-ee71-4307-8757-fda6c55dc912] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48982. May 18 01:46:51.403880 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b9981d9c-f29e-47ef-820a-371d3fdee067 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.397063 May 18 01:46:51.426480 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 451/942] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:46:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:46:51.440777 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a4e90abb-0d93-4bb6-a8c0-99a36adc396d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:51.442128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a4e90abb-0d93-4bb6-a8c0-99a36adc396d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:51.543990 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a4e90abb-0d93-4bb6-a8c0-99a36adc396d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:51.562713 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a4e90abb-0d93-4bb6-a8c0-99a36adc396d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1094 microversion: 2.1 time: 0.128983 May 18 01:46:51.564555 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 492/943] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:51 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:52.581190 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:52.582400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:52.591290 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:52.591995 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:52.592982 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:52.594061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:52.723402 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:52.733227 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a6071c0c-50c9-4b7c-85cd-aecc47eb80d2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1144 microversion: 2.1 time: 0.155692 May 18 01:46:52.744115 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 452/944] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:52 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1144 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:53.754050 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:53.755731 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:53.779493 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:53.779951 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:53.780771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:53.790174 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:53.981284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:53.990676 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ad7e681c-b9ab-4e2f-aa26-bb6298a7c8ad tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1192 microversion: 2.1 time: 0.243173 May 18 01:46:53.991296 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 493/945] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:53 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1192 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:46:55.010114 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:55.012289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:55.023199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:55.023759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:55.024832 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:55.029725 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:55.222498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:55.238679 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c0c6a123-ce29-430b-8c1f-1dfb731308bb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1210 microversion: 2.1 time: 0.233513 May 18 01:46:55.239425 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 453/946] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:55 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1210 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:56.259311 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:56.260651 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:56.272710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:56.273196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:56.274183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:56.276524 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:56.915114 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:56.925394 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3072726d-aaf6-4fe2-ac5f-af08c859d848 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.670198 May 18 01:46:56.925975 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 494/947] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:56 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:57.143323 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-00901081-0d64-4958-a937-2e90001a18d8 req-368a0edd-4046-48e5-ad96-aff9f3d42cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb1c42d-d846-47fa-9375-7222a25ddd03", "tag": "d7302219-5c9c-406e-a03c-2e983e47736e"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:46:57.144983 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:46:57.144983 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:46:57.155658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-00901081-0d64-4958-a937-2e90001a18d8 req-368a0edd-4046-48e5-ad96-aff9f3d42cf5 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:57.156120 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-00901081-0d64-4958-a937-2e90001a18d8 req-368a0edd-4046-48e5-ad96-aff9f3d42cf5 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:57.176025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-00901081-0d64-4958-a937-2e90001a18d8 req-368a0edd-4046-48e5-ad96-aff9f3d42cf5 service nova] Creating event network-changed:d7302219-5c9c-406e-a03c-2e983e47736e for instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 on hv-cinder-78462 May 18 01:46:57.181162 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-00901081-0d64-4958-a937-2e90001a18d8 req-368a0edd-4046-48e5-ad96-aff9f3d42cf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042105 May 18 01:46:57.182678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 454/948] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:46:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:46:57.943226 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:57.944159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:57.956077 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:57.959049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:57.959956 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:57.960794 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:58.171815 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:58.182674 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b5b13eac-19c5-42bf-bdab-df151bb25f67 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.243069 May 18 01:46:58.183560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 495/949] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:57 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:46:59.199513 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:46:59.200125 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:46:59.207748 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:59.208722 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:59.209026 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:46:59.209494 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:46:59.424457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:46:59.435661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7df7aa32-ffa7-461a-82d1-2225cfb3f7aa tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.240308 May 18 01:46:59.436999 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 455/950] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:46:59 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:00.397677 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'create', calling method: .version_select at 0x7efcd952e4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-98014054"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:00.419538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:47:00.423645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for user 8bebf6029be04af4922e46f0ae040327 and project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:47:00.453058 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:00.453767 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:00.461553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:00.462011 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:00.462911 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:00.463434 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:00.690824 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:47:00.695022 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for user 8bebf6029be04af4922e46f0ae040327 and project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'key_pairs'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:47:00.708330 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-07274db1-a8a9-46ee-bfee-623065faf3e5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.314386 May 18 01:47:00.708938 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 496/951] 10.222.0.16 () {60 vars in 1158 bytes} [Tue May 18 01:47:00 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:00.762710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-429683831", "imageRef": "f8a107a0-f240-47c6-ba38-91dc7f1a30f9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-98014054", "networks": [{"uuid": "9824fe6f-b7a1-400f-9a0d-d9aa9909e1fa"}]}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:00.842622 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.network.neutron [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] validate_networks() for [('9824fe6f-b7a1-400f-9a0d-d9aa9909e1fa', None, None, None)] {{(pid=92949) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:47:00.851462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:00.860708 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8fd8b660-beb5-4ac9-a46a-46dc576465dc tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.411333 May 18 01:47:00.861477 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 456/952] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:00 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:01.639030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Flavor limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:47:01.639488 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Image limits 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:47:01.639935 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Flavor pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:47:01.640371 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Image pref 0:0:0 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:47:01.640793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.virt.hardware [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:47:01.649120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:01.649569 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:01.650516 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:01.651007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:01.668757 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:47:01.672717 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.quota [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Getting quotas for user 8bebf6029be04af4922e46f0ae040327 and project 9b0c3cb4d3634c8080132e61a0648e51. Resources: {'instances', 'cores', 'ram'} {{(pid=92949) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:47:01.683795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Going to run 1 instances... {{(pid=92949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:47:01.686056 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f8a107a0-f240-47c6-ba38-91dc7f1a30f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:47:01.733923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-961c6f5a-4d94-4b4b-bbdf-02169cb60f12 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975041 May 18 01:47:01.734923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 497/953] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:47:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 01:47:01.745349 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c6daecbd-06de-4ee6-9c2d-71a6e5924b46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:01.746570 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c6daecbd-06de-4ee6-9c2d-71a6e5924b46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:01.817851 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c6daecbd-06de-4ee6-9c2d-71a6e5924b46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:01.826658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c6daecbd-06de-4ee6-9c2d-71a6e5924b46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1256 microversion: 2.1 time: 0.085982 May 18 01:47:01.827442 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 457/954] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:01 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1256 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:01.878536 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:01.879193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:01.887301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:01.887647 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:01.888468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:01.888907 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:02.139339 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:02.148441 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c9d2f07c-8aa2-4bca-9859-fe088f008890 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.273747 May 18 01:47:02.159058 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 498/955] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:01 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:02.845487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:02.846269 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:02.855528 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:02.855979 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:02.856943 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:02.857543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.005779 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:03.015533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-443d2f53-4009-4344-a44d-988990c5ef3b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1316 microversion: 2.1 time: 0.176093 May 18 01:47:03.016108 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 458/956] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:02 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:03.169805 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:03.171076 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:03.180971 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.182518 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.184159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.184813 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.324276 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:03.329238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:03.340771 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.341684 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.342620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.343209 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.432641 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:47:03.500169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:03.509377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-50c029cb-3fed-45d0-9b02-8ff2df5473c2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.346147 May 18 01:47:03.509977 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 499/957] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:03 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:03.690740 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6fbccd9b-a8f2-4c51-b267-b179c7985426 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 204 len: 0 microversion: 2.1 time: 0.372582 May 18 01:47:03.691596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 459/958] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:47:03 2021] DELETE /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:47:03.702335 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:03.714852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:03.731059 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.732611 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.732611 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.732949 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.833565 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-d78c3ec0-0da1-41e6-8291-003a9bd99472 req-14fcdfb7-7e90-46ee-92a3-8766183f63d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:03.835719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:03.835719 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:03.857598 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d78c3ec0-0da1-41e6-8291-003a9bd99472 req-14fcdfb7-7e90-46ee-92a3-8766183f63d1 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:03.859611 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-d78c3ec0-0da1-41e6-8291-003a9bd99472 req-14fcdfb7-7e90-46ee-92a3-8766183f63d1 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:03.896533 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-d78c3ec0-0da1-41e6-8291-003a9bd99472 req-14fcdfb7-7e90-46ee-92a3-8766183f63d1 service nova] Creating event network-changed:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:47:03.906916 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-d78c3ec0-0da1-41e6-8291-003a9bd99472 req-14fcdfb7-7e90-46ee-92a3-8766183f63d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395705 May 18 01:47:03.908129 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 500/959] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:04.034043 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:04.035193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:04.061165 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:04.077212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:04.079706 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:04.082738 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:04.331965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:04.342224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9c1bd70d-0553-45e8-b5e2-3dbd5c27d4be tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1314 microversion: 2.1 time: 0.313267 May 18 01:47:04.348653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 501/960] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:04 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:04.445256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:04.462702 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e712c74b-4430-4587-b861-2eaf7c92ef89 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.764941 May 18 01:47:04.466033 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 460/961] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:03 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:04.526839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:04.527848 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:04.540532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:04.544542 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:04.545520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:04.546068 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:04.988030 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:04.998895 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-37ad6b69-7ae7-402b-91ab-c4e9a0af8652 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.476070 May 18 01:47:04.999238 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 502/962] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:04 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:05.366123 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:05.366754 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:05.378343 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:05.378804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:05.379605 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:05.380063 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:05.483051 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:05.483698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:05.511703 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:05.514465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:05.515312 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:05.515791 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:05.883935 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:05.897465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-53fae06e-f778-496c-a962-dcdf073f1f43 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.534837 May 18 01:47:05.898342 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 461/963] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:05 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:05.905037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:05.914436 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3a65c307-65aa-4800-b8e0-7fba04d0207a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.434979 May 18 01:47:05.916339 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 503/964] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:05 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:06.016185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:06.017381 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:06.026756 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.027226 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:06.028261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.028712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:06.271974 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:06.282124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-baef98c6-3bdb-4a5b-95e6-536db2c67296 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.270144 May 18 01:47:06.283309 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 462/965] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:06 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:06.915051 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:06.917040 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:06.934300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:06.935475 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:06.949604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.953664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:06.953899 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.954468 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:06.955023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.955301 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:06.955755 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:06.956286 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:07.330743 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:07.335806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:07.347121 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1335e0d7-b1ff-4de8-b249-a6bfdd54012e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.436090 May 18 01:47:07.347710 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 504/966] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:06 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:07.350045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-087605db-4be0-4bd2-a988-ac0eda1ca60c tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.420844 May 18 01:47:07.350845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 463/967] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:06 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:07.352041 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:07.352848 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:07.365302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:07.365764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:07.366557 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:07.367003 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:07.645192 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:07.653486 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a1422f22-f765-4a13-a786-7a185e949844 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.304801 May 18 01:47:07.654151 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 505/968] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:07 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:08.367606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:08.368280 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:08.368704 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:08.368811 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:08.379634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.380390 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:08.381199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.381639 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:08.382298 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.384284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:08.385984 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.389696 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:08.709388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:08.715165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:08.722065 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-df69fc4e-409a-4acf-af1b-e739fe540fba tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.357966 May 18 01:47:08.725209 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 506/969] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:08 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:08.732331 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:08.736346 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7ddf1628-3d5b-490a-ae26-59fe5f0ad2c7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.363983 May 18 01:47:08.738668 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:08.748009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 464/970] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:08 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:08.751146 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.751989 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:08.753110 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:08.753774 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:09.173513 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:09.182131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d71e92f0-c1cb-4602-831a-8cc570947443 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.454140 May 18 01:47:09.183141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 507/971] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:08 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:09.742499 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:09.743869 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:09.753269 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:09.753987 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:09.754878 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:09.755377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:09.755377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:09.755560 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:09.763837 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:09.764295 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:09.765120 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:09.765575 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:10.205845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:10.219388 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-150417b1-bb9d-43c1-8ebf-5d2302f5dd25 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.467897 May 18 01:47:10.220656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 508/972] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:09 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:10.231393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:10.233307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:10.249699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:10.250300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:10.250606 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:10.251601 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:10.252240 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:10.264473 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3d28b52a-dca9-41ed-8db4-fe4e841a3f3a tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.524263 May 18 01:47:10.277213 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 465/973] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:09 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:10.533075 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:10.544588 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-80b37758-7c1a-4886-b47b-d26e8513ce11 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.322424 May 18 01:47:10.558788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 509/974] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:10 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:11.237424 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:11.238052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:11.248237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.248718 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.249501 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.249970 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.282521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:11.283128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:11.292343 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.293032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.293812 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.294248 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.599143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:11.603954 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:11.613440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a57fd44e-b602-475a-b2e2-5624caed5966 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.379569 May 18 01:47:11.614858 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 466/975] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:11 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:11.615284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-16c24bd6-48a8-4ca6-845f-8e81219b687d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.333575 May 18 01:47:11.616208 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 510/976] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:11 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:11.628095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:11.631457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:11.640729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.641435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.644197 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:11.644845 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:11.874565 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:11.897375 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-358e5083-7b18-4c42-ac49-8d8853b39729 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.280241 May 18 01:47:11.898068 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 467/977] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:11 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:12.639039 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:12.640337 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:12.641030 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:12.641642 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:12.647448 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:12.647901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:12.648712 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:12.649142 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:12.649487 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:12.650117 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:12.652115 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:12.652753 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:13.002907 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:13.004733 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:13.013777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-45cdbf1a-1c3b-479d-ba41-3ebf4fb022f7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.376137 May 18 01:47:13.023407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-23b1acbb-e7b2-496d-b0a8-061c735436f9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.378978 May 18 01:47:13.023615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 468/978] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:12 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:13.023615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:13.023615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:13.029548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:13.029780 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:13.030420 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 511/979] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:12 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:13.030773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:13.031272 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:13.303255 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:13.313307 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-da0ffad1-9dca-445a-a8ca-07c71aa20507 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.297293 May 18 01:47:13.314238 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 469/980] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:13 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:14.031170 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:14.031789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:14.039284 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.039745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.040548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.041635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.046382 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:14.047045 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:14.054305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.054838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.055625 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.056069 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.336023 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:14.340847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:14.345005 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-411671a3-00ce-4f81-b998-2755174fdacd tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.317521 May 18 01:47:14.346693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 512/981] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:14 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:14.350571 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-62d1afc6-f321-495c-8716-6df8228171a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.307889 May 18 01:47:14.351267 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:14.356784 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:14.357219 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 470/982] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:14 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:14.360133 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.360613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.361789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:14.361789 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:14.754908 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:14.763162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b1e4994c-e657-4817-92bf-2be5d70b8450 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.415282 May 18 01:47:14.763817 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 513/983] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:14 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:15.364724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:15.365411 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:15.367746 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:15.368378 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:15.373996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.374451 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.375237 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.375794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.377145 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.377593 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.378403 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.378886 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.797273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:15.801978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:15.806049 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-9118a461-f5c7-4a8d-a380-be0053977a48 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.441861 May 18 01:47:15.806818 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 514/984] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:15 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:15.811561 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-6e764fa6-1c95-4974-b764-8bb883538c15 req-f020fe05-a4a9-43b1-a627-234a77a04e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:15.813340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:15.813340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:15.817239 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-08184f89-582e-492c-9673-8471e1b9b15d tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1566 microversion: 2.1 time: 0.456114 May 18 01:47:15.817896 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 471/985] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:15 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1566 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:15.822530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:15.823239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-6e764fa6-1c95-4974-b764-8bb883538c15 req-f020fe05-a4a9-43b1-a627-234a77a04e2b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.823661 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:15.823785 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-6e764fa6-1c95-4974-b764-8bb883538c15 req-f020fe05-a4a9-43b1-a627-234a77a04e2b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.831585 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.832108 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.832939 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:15.833384 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:15.841499 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-6e764fa6-1c95-4974-b764-8bb883538c15 req-f020fe05-a4a9-43b1-a627-234a77a04e2b service nova] Creating event network-changed:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:47:15.846694 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-6e764fa6-1c95-4974-b764-8bb883538c15 req-f020fe05-a4a9-43b1-a627-234a77a04e2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038498 May 18 01:47:15.847272 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 515/986] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:16.027930 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:16.035943 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6d34df7f-8a45-45cd-b611-4acd14dda037 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.216841 May 18 01:47:16.036540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 472/987] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:15 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:16.823478 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:16.824196 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:16.831690 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:16.832143 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:16.832945 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:16.833387 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:16.834676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:16.835288 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:16.843165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:16.843621 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:16.844435 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:16.844874 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:17.136244 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:17.138648 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:17.144646 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-49a002f0-eba8-4225-b513-5060770786e9 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.325326 May 18 01:47:17.145243 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 516/988] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:16 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:17.154813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-6ce14fb9-2bfb-4dfe-8178-f5b9b21ca984 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1447 microversion: 2.1 time: 0.316025 May 18 01:47:17.154813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 473/989] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:16 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:17.155046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:17.155046 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:17.158391 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:17.158843 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:17.159613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:17.160047 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:17.349588 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:17.358208 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-223f5465-0571-4468-8f43-34d63625d7e1 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.212016 May 18 01:47:17.358768 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 517/990] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:17 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:18.162213 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:18.162839 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:18.164960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:18.165608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:18.171062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.171520 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:18.172294 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.172751 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:18.173521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.173973 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:18.174744 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.175181 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:18.696536 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:18.705481 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:18.707416 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-111e0e6d-3ff4-4e03-943e-a4fd366b54d8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.548928 May 18 01:47:18.715546 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b2c27805-3054-4cac-80cb-a5f934451ed7 tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1447 microversion: 2.1 time: 0.554216 May 18 01:47:18.717666 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 474/991] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:18 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:18.722455 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 518/992] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:18 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1447 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:18.723328 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:18.723952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:18.732655 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.733116 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:18.734352 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:18.734799 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.091871 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:19.100986 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d78ed424-dbbd-4c0a-8f85-8b29062c5cc8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.381913 May 18 01:47:19.102266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 475/993] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:18 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:19.286290 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-18488591-9320-43b2-8ad6-2f3ccb92d3d8 req-876f501e-1207-4dd5-9cbf-93e8af81564c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451", "name": "network-vif-deleted", "tag": "1edc3375-334f-4bd6-bad0-7416484b0c9f"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:19.288074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:19.288074 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:19.296979 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-18488591-9320-43b2-8ad6-2f3ccb92d3d8 req-876f501e-1207-4dd5-9cbf-93e8af81564c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:19.297444 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-18488591-9320-43b2-8ad6-2f3ccb92d3d8 req-876f501e-1207-4dd5-9cbf-93e8af81564c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.326439 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-18488591-9320-43b2-8ad6-2f3ccb92d3d8 req-876f501e-1207-4dd5-9cbf-93e8af81564c service nova] Creating event network-vif-deleted:1edc3375-334f-4bd6-bad0-7416484b0c9f for instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 on hv-cinder-78462 May 18 01:47:19.331594 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-18488591-9320-43b2-8ad6-2f3ccb92d3d8 req-876f501e-1207-4dd5-9cbf-93e8af81564c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049115 May 18 01:47:19.332175 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 519/994] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:19.725032 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:19.725676 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:19.733429 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:19.733946 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:19.734404 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.734535 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:19.735176 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:19.735609 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.741793 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:19.742255 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.743044 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:19.743548 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:19.900333 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c7fbb09ac043a6a6827e1885505577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a3a93319a54320819f6f385f3682b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:19.913965 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-fd1a8107-d6b9-4244-8df6-f30e62ad8abf tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 200 len: 1218 microversion: 2.1 time: 0.185109 May 18 01:47:19.914545 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 520/995] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:19 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:19.987264 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:19.995946 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b287f644-c6fb-4529-a041-6ecae0e59506 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.274611 May 18 01:47:19.996534 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 476/996] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:19 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:20.117984 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:20.118640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:20.126205 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:20.126666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:20.127547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:20.127999 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:20.331526 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:20.340858 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-34e9eae7-2282-4bf1-b546-2b4f605ae98f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.226617 May 18 01:47:20.341414 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 521/997] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:20 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:20.930829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:20.931996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] [instance: dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:20.939320 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:20.939779 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:20.940620 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:20.941066 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:20.990292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] HTTP exception thrown: Instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 could not be found. May 18 01:47:20.990914 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Returning 404 to user: Instance dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:47:20.991759 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7f7db232-e1b0-498c-8989-f374cd61992e tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451" status: 404 len: 111 microversion: 2.1 time: 0.064664 May 18 01:47:20.992548 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 477/998] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:20 2021] GET /compute/v2.1/servers/dc2c5ae5-b46c-4a24-a46d-b9d4cb72a451 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:47:21.014239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:21.015163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:21.022778 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:21.023317 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:21.024204 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:21.024808 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:21.284765 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:21.302943 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-cfecb94c-8be9-4a4b-bdd9-9640b00ba633 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.293347 May 18 01:47:21.303895 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 522/999] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:21 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:21.308625 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ff8e2dcf-5568-46ea-ba60-546ff48165ff tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] Calling method '.version_select at 0x7efcda115dc0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:21.328671 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ff8e2dcf-5568-46ea-ba60-546ff48165ff tempest-TestShelveInstance-1082379479 tempest-TestShelveInstance-1082379479-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-927515522" status: 202 len: 0 microversion: 2.1 time: 0.024192 May 18 01:47:21.329362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 478/1000] 10.222.0.16 () {58 vars in 1251 bytes} [Tue May 18 01:47:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-927515522 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:47:21.358228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:21.358868 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:21.366271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:21.366739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:21.367522 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:21.368190 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:21.653221 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:21.662821 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-edf76ddb-c603-4844-a55f-f005c6ef34fe tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.309156 May 18 01:47:21.664423 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 523/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:21 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:22.320037 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:22.321266 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:22.329813 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:22.330279 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:22.331061 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:22.331500 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:22.681465 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:22.684157 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:22.688226 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:22.706298 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ef4f6cdb-cff5-4776-b637-7eb2dd8e2192 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.390224 May 18 01:47:22.708237 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:22.709022 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 479/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:22 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:22.709914 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:22.711212 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:22.711982 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:22.959720 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-bbc07a6e-da16-4297-b42d-20b548f8bc91 req-c3ab21b3-4b99-422d-9504-23f4d5f122df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb1c42d-d846-47fa-9375-7222a25ddd03", "name": "network-vif-plugged", "status": "completed", "tag": "d7302219-5c9c-406e-a03c-2e983e47736e"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:22.962212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:22.962212 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:47:22.981996 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-bbc07a6e-da16-4297-b42d-20b548f8bc91 req-c3ab21b3-4b99-422d-9504-23f4d5f122df service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:22.987533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-bbc07a6e-da16-4297-b42d-20b548f8bc91 req-c3ab21b3-4b99-422d-9504-23f4d5f122df service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:23.022074 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-bbc07a6e-da16-4297-b42d-20b548f8bc91 req-c3ab21b3-4b99-422d-9504-23f4d5f122df service nova] Creating event network-vif-plugged:d7302219-5c9c-406e-a03c-2e983e47736e for instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 on hv-cinder-78462 May 18 01:47:23.028440 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-bbc07a6e-da16-4297-b42d-20b548f8bc91 req-c3ab21b3-4b99-422d-9504-23f4d5f122df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072761 May 18 01:47:23.029204 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 480/1003] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:23.215358 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:23.224131 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-657deb88-9500-467d-a1e5-2b64b3488420 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1266 microversion: 2.1 time: 0.547235 May 18 01:47:23.234091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 524/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:22 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1266 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:23.726046 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:23.727297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:23.737109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:23.737563 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:23.738737 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:23.739185 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:24.185606 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:24.195659 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-79827f3f-8481-4e93-a1ea-6d79da634764 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.473204 May 18 01:47:24.197468 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 481/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:23 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:47:24.241199 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:24.241739 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:24.249893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:24.250353 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:24.251148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:24.251655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:24.664893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:24.676140 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c1dd2718-1fb9-477f-9c57-5e995a774df0 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1453 microversion: 2.1 time: 0.438683 May 18 01:47:24.676745 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 525/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:24 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1453 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:24.692646 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:24.693267 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:24.701044 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:24.701506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:24.702293 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:24.702735 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:24.937593 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:24.946562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-8f3202e5-4c91-4516-b8ec-6d05323fd1a2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1453 microversion: 2.1 time: 0.257500 May 18 01:47:24.947693 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 482/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:24 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1453 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:25.123252 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-9cf4c960-4554-46b2-8dd0-6486a6bea232 req-7b64a847-085d-42dd-a6d4-4317465a3023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "name": "network-vif-plugged", "status": "completed", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:25.125099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:25.125099 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:25.136008 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9cf4c960-4554-46b2-8dd0-6486a6bea232 req-7b64a847-085d-42dd-a6d4-4317465a3023 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:25.136847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9cf4c960-4554-46b2-8dd0-6486a6bea232 req-7b64a847-085d-42dd-a6d4-4317465a3023 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:25.159337 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-9cf4c960-4554-46b2-8dd0-6486a6bea232 req-7b64a847-085d-42dd-a6d4-4317465a3023 service nova] Creating event network-vif-plugged:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:47:25.167341 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-9cf4c960-4554-46b2-8dd0-6486a6bea232 req-7b64a847-085d-42dd-a6d4-4317465a3023 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050345 May 18 01:47:25.168596 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 526/1008] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:25.225140 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:25.226174 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:25.238618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:25.243416 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:25.245253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:25.246678 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:25.440171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7960fc8c-6c4d-4497-8e73-309bb2ac4fbc] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 18 01:47:25.737180 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:25.750151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1f2b9f5f-9d96-4111-bc4e-c1d38effc99b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1356 microversion: 2.1 time: 0.540187 May 18 01:47:25.751171 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 483/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:25 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1356 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:26.775033 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:26.776600 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:26.785001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:26.785627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:26.786361 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:26.786861 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.188117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:27.197986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f1eba0b0-f0cb-4572-bc2d-11e241a8a0d7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1546 microversion: 2.1 time: 0.428039 May 18 01:47:27.198628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 527/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:26 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1546 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:27.226975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:27.227724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:27.236031 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.236817 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.237693 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.238229 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.306887 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] [7960fc8c-6c4d-4497-8e73-309bb2ac4fbc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49592. May 18 01:47:27.575256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:27.602005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1e050e47-da7f-4c25-95c8-ae97d25b4447 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1546 microversion: 2.1 time: 0.391063 May 18 01:47:27.602949 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 484/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:27 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1546 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:27.626135 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:27.631740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:27.631740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:27.633851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:27.635816 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Searching by: {'deleted': False, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51'} {{(pid=92949) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 18 01:47:27.644931 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.645640 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.647086 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.647987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.782767 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.multi_cell_list [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=92949) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 18 01:47:27.894307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-ea826b5e-f0c9-4b1a-af32-b1b64d429bd1 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.279296 May 18 01:47:27.895700 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 528/1012] 10.222.0.16 () {58 vars in 1125 bytes} [Tue May 18 01:47:27 2021] GET /compute/v2.1/servers => generated 342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:27.907385 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:27.908488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:27.930895 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.932434 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:27.933801 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:27.934467 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:28.521838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:28.531992 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f0270c98-e4bd-488e-b1f8-eea8977fa0d2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1546 microversion: 2.1 time: 0.628738 May 18 01:47:28.533522 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 485/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:27 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1546 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:29.167116 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-40802c07-b602-4c35-9572-b7fe6164fefc req-8677b525-1d60-40fd-90d7-bc44bb6b4a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb1c42d-d846-47fa-9375-7222a25ddd03", "tag": "d7302219-5c9c-406e-a03c-2e983e47736e"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:29.168605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:29.168605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:29.185729 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-40802c07-b602-4c35-9572-b7fe6164fefc req-8677b525-1d60-40fd-90d7-bc44bb6b4a2b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:29.187835 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-40802c07-b602-4c35-9572-b7fe6164fefc req-8677b525-1d60-40fd-90d7-bc44bb6b4a2b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:29.221500 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-40802c07-b602-4c35-9572-b7fe6164fefc req-8677b525-1d60-40fd-90d7-bc44bb6b4a2b service nova] Creating event network-changed:d7302219-5c9c-406e-a03c-2e983e47736e for instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 on hv-cinder-78462 May 18 01:47:29.234843 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-40802c07-b602-4c35-9572-b7fe6164fefc req-8677b525-1d60-40fd-90d7-bc44bb6b4a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075397 May 18 01:47:29.235818 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 529/1014] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:30.455289 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c239f668-0f7c-49a2-aecb-abb000469cb5"}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:30.456553 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:30.464807 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:30.465398 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:30.466305 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:30.466847 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:30.914406 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-facdc65c-c209-4ded-bf71-fc21714a6ffd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462774 May 18 01:47:30.917121 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 486/1015] 10.222.0.16 () {60 vars in 1323 bytes} [Tue May 18 01:47:30 2021] POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:38.034264 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:38.034966 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:38.042942 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:38.043397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:38.044169 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:38.044645 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:38.239014 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:38.247619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-be930782-5d9d-4fba-9945-bde96ac6ab32 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1592 microversion: 2.1 time: 0.217617 May 18 01:47:38.248193 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 530/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:38 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1592 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:47:40.870481 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-09888d86-c281-474a-87c1-19c2054952bc req-1546fab7-1a99-4563-9344-57e755d84551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:40.877299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:40.877299 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:47:40.888020 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-09888d86-c281-474a-87c1-19c2054952bc req-1546fab7-1a99-4563-9344-57e755d84551 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:40.888575 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-09888d86-c281-474a-87c1-19c2054952bc req-1546fab7-1a99-4563-9344-57e755d84551 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:40.907016 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-09888d86-c281-474a-87c1-19c2054952bc req-1546fab7-1a99-4563-9344-57e755d84551 service nova] Creating event network-changed:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:47:40.912003 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-09888d86-c281-474a-87c1-19c2054952bc req-1546fab7-1a99-4563-9344-57e755d84551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046407 May 18 01:47:40.912841 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 487/1017] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:42.502377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-608112467"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:42.502926 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:42.510141 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:42.510790 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:42.511711 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:42.512159 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:42.699602 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.network.security_group_api [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Adding security group 690fbe40-6363-4601-a910-0c2f3431b9e4 to port 392d4826-ca87-4f90-8dc7-881f65216ff1 May 18 01:47:43.188927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-94b95707-22cd-4f22-aebf-9e6433595a22 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action" status: 202 len: 0 microversion: 2.1 time: 0.690243 May 18 01:47:43.190364 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 531/1018] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:47:42 2021] POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:47:43.209125 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-2692bf3e-b430-4f48-bea3-fdcb9b656a70 req-b710f6b4-68f6-4403-b3ba-5c8530c0d3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:47:43.212831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:47:43.214432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:47:43.214432 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:47:43.214650 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:47:43.225279 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2692bf3e-b430-4f48-bea3-fdcb9b656a70 req-b710f6b4-68f6-4403-b3ba-5c8530c0d3f9 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:43.225893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-2692bf3e-b430-4f48-bea3-fdcb9b656a70 req-b710f6b4-68f6-4403-b3ba-5c8530c0d3f9 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:43.228615 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:43.229082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:43.230483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:47:43.230929 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:47:43.248754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-2692bf3e-b430-4f48-bea3-fdcb9b656a70 req-b710f6b4-68f6-4403-b3ba-5c8530c0d3f9 service nova] Creating event network-changed:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:47:43.257414 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-2692bf3e-b430-4f48-bea3-fdcb9b656a70 req-b710f6b4-68f6-4403-b3ba-5c8530c0d3f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051597 May 18 01:47:43.258520 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 532/1019] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:47:43.454072 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:47:43.463244 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-958074a8-4be1-44f6-a0b6-ea8f709f9734 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1755 microversion: 2.1 time: 0.265172 May 18 01:47:43.463843 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 488/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:47:43 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:00.457356 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:48:00.458397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:00.466863 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:00.467321 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:00.468106 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:00.468576 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:00.609920 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d38d94fa-9547-458c-a6e8-a97fcfbc43dd tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action" status: 202 len: 0 microversion: 2.1 time: 0.156628 May 18 01:48:00.610810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 533/1021] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:48:00 2021] POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:48:00.618393 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:00.619005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:00.627165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:00.627531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:00.628337 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:00.628780 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:00.826311 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:00.834884 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-5b280f2a-b68c-429d-8f5a-2cfc54046945 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1747 microversion: 2.1 time: 0.220193 May 18 01:48:00.835461 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 489/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:00 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1747 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:01.853071 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:01.853829 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:01.861790 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:01.862249 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:01.863024 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:01.863464 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:02.066003 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:02.075322 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-e423d37a-a597-4423-bb61-a8ecd1b986b5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.225901 May 18 01:48:02.075985 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 534/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:01 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:03.093157 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:03.093772 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:03.101005 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:03.101483 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:03.102240 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:03.102670 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:03.295925 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:03.304562 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1a0a2067-e7c1-4e50-8bd6-b2219f8bce42 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.215653 May 18 01:48:03.305118 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 490/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:03 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:04.322160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:04.322769 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:04.330817 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:04.331266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:04.332060 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:04.332563 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:04.620521 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:04.629552 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-189aa33b-afe4-42c1-b033-7544e874630c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.311075 May 18 01:48:04.630161 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 535/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:04 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:05.646682 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:05.647292 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:05.656053 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:05.656537 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:05.657308 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:05.657747 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:05.859886 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:05.868431 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-f43494c5-f9f8-4391-a9c6-d6c56541ad09 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.225426 May 18 01:48:05.868997 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 491/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:05 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:06.886302 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:06.886913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:06.895118 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:06.895566 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:06.896348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:06.896782 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:07.096011 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:07.104693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-890dcab1-55fa-4f57-9872-cafda4d495a2 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.222078 May 18 01:48:07.105257 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 536/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:06 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:08.121396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:08.122466 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:08.129695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:08.130150 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:08.130922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:08.131362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:08.323496 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:08.332253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-cfbb4ff5-1b8a-483c-9d07-1b482ff14842 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.214630 May 18 01:48:08.332838 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 492/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:08 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:09.349766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:09.350379 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:09.357667 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:09.358117 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:09.358887 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:09.359320 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:09.554901 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:09.564037 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c8712747-e5f5-4d86-824b-e57186c72aa5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.218188 May 18 01:48:09.564635 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 537/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:09 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:10.580935 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:10.581549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:10.589043 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:10.589492 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:10.590256 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:10.591202 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:10.785994 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:10.794539 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-aa450e5b-f104-4e0c-ac70-48d2a9a48df7 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.217811 May 18 01:48:10.795106 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 493/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:10 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:11.811031 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:11.811653 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:11.818933 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:11.819389 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:11.820166 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:11.820652 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:12.017464 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:12.026007 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-1221e2eb-16e8-49e3-bd8e-dbd56adf2f46 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1752 microversion: 2.1 time: 0.218898 May 18 01:48:12.026571 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 538/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:11 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:13.043479 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:13.044934 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:13.058300 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:13.058752 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:13.060220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:13.060696 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:13.263430 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:13.271945 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-b9cd5133-c378-492a-9779-7a27da1a3e6f tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1755 microversion: 2.1 time: 0.232143 May 18 01:48:13.272540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 494/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:13 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:45.607661 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-608112467"}} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:48:45.608228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:45.616171 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:45.616718 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:45.618001 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:45.618783 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:45.923293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.network.security_group_api [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Removing security group 690fbe40-6363-4601-a910-0c2f3431b9e4 from port 392d4826-ca87-4f90-8dc7-881f65216ff1 May 18 01:48:46.387474 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c0e9de14-97ac-46c7-aab1-b21c1ca3bdd8 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action" status: 202 len: 0 microversion: 2.1 time: 0.783825 May 18 01:48:46.388377 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 539/1033] 10.222.0.16 () {60 vars in 1278 bytes} [Tue May 18 01:48:45 2021] POST /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:48:46.398443 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-08daeb11-1740-404b-8c8b-c9d9ba5c0eba req-edbae4fd-f2fd-45e5-990d-d97e312af968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:48:46.400178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:48:46.400178 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:48:46.411318 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-08daeb11-1740-404b-8c8b-c9d9ba5c0eba req-edbae4fd-f2fd-45e5-990d-d97e312af968 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:46.411777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-08daeb11-1740-404b-8c8b-c9d9ba5c0eba req-edbae4fd-f2fd-45e5-990d-d97e312af968 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:46.438357 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-08daeb11-1740-404b-8c8b-c9d9ba5c0eba req-edbae4fd-f2fd-45e5-990d-d97e312af968 service nova] Creating event network-changed:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:48:46.454708 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-08daeb11-1740-404b-8c8b-c9d9ba5c0eba req-edbae4fd-f2fd-45e5-990d-d97e312af968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059884 May 18 01:48:46.456490 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 495/1034] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:48:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:48:48.295666 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:48.296285 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:48.304266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:48.304764 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:48.305535 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:48.305974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:48.463980 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.objects.instance [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lazy-loading 'services' on Instance uuid 73f24893-2444-4657-8f7e-64d634c07212 {{(pid=92949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 18 01:48:48.470559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-a90213cd-5f44-4ba1-b7b6-6075a629868e req-fa3702c2-b05e-4420-9723-c9557bcd282c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:48:48.472631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:48:48.472631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:48:48.481208 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a90213cd-5f44-4ba1-b7b6-6075a629868e req-fa3702c2-b05e-4420-9723-c9557bcd282c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:48.481658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-a90213cd-5f44-4ba1-b7b6-6075a629868e req-fa3702c2-b05e-4420-9723-c9557bcd282c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:48.498729 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-a90213cd-5f44-4ba1-b7b6-6075a629868e req-fa3702c2-b05e-4420-9723-c9557bcd282c service nova] Creating event network-changed:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:48:48.504124 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-a90213cd-5f44-4ba1-b7b6-6075a629868e req-fa3702c2-b05e-4420-9723-c9557bcd282c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 May 18 01:48:48.504894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 496/1035] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:48:48.606128 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d010d2af-6615-405e-9e32-65ee92e7e56b tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments/c239f668-0f7c-49a2-aecb-abb000469cb5" status: 202 len: 0 microversion: 2.1 time: 0.314003 May 18 01:48:48.606754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 540/1036] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:48:48 2021] DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments/c239f668-0f7c-49a2-aecb-abb000469cb5 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:48:48.617408 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:48.618769 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:48.628568 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:48.629146 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:48.630088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:48.630664 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:48.698662 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e5c714af-a8ca-4336-a6df-1e9dacda3b3e tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087058 May 18 01:48:48.702998 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 497/1037] 10.222.0.16 () {58 vars in 1302 bytes} [Tue May 18 01:48:48 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:48:49.711740 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:49.713112 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:49.721375 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:49.721974 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:49.722547 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:49.722988 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:49.788286 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-6fd3dfac-7143-44d0-afae-dc3ee5e8f493 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080846 May 18 01:48:49.788870 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 541/1038] 10.222.0.16 () {58 vars in 1302 bytes} [Tue May 18 01:48:49 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 01:48:49.798596 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:49.799198 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:49.806459 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:49.806909 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:49.807669 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:49.808199 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:50.066462 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] HTTP exception thrown: Instance 73f24893-2444-4657-8f7e-64d634c07212 is not attached to volume c239f668-0f7c-49a2-aecb-abb000469cb5 May 18 01:48:50.067067 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Returning 404 to user: Instance 73f24893-2444-4657-8f7e-64d634c07212 is not attached to volume c239f668-0f7c-49a2-aecb-abb000469cb5 {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:48:50.067892 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-e77fb7f1-433c-420b-9cdb-68b53759e6cb tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments/c239f668-0f7c-49a2-aecb-abb000469cb5" status: 404 len: 154 microversion: 2.1 time: 0.273160 May 18 01:48:50.068457 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 498/1039] 10.222.0.16 () {58 vars in 1416 bytes} [Tue May 18 01:48:49 2021] DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212/os-volume_attachments/c239f668-0f7c-49a2-aecb-abb000469cb5 => generated 154 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:48:51.302903 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:51.303393 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:51.310952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:51.311407 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:51.312215 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:51.312693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:51.372654 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Going to try to terminate instance {{(pid=92949) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:48:51.478915 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-88107c05-0e23-4579-8023-30412f22a549 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 204 len: 0 microversion: 2.1 time: 0.179975 May 18 01:48:51.479699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 542/1040] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:48:51 2021] DELETE /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:48:51.488285 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:51.488931 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:51.496034 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:51.496578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:51.497294 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:51.497732 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:51.709631 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:51.718136 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-9aa4ae49-0a1f-443b-906e-a3689378353c tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1552 microversion: 2.1 time: 0.234330 May 18 01:48:51.718695 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 499/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:51 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:52.736235 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:52.737660 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:52.744960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:52.745412 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:52.746198 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:52.746627 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:52.945414 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:52.955259 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2343f7d4-1e96-4088-84c0-8e5ec44a4686 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1552 microversion: 2.1 time: 0.223103 May 18 01:48:52.957680 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 543/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:52 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:53.939560 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-aa8f757c-5e6b-4f11-a5dc-3c0f3012afbc req-7aa1f1de-3c6b-4e38-82df-b56c3ab2ec8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f24893-2444-4657-8f7e-64d634c07212", "name": "network-vif-deleted", "tag": "392d4826-ca87-4f90-8dc7-881f65216ff1"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:48:53.942253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:48:53.942253 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:48:53.951261 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-aa8f757c-5e6b-4f11-a5dc-3c0f3012afbc req-7aa1f1de-3c6b-4e38-82df-b56c3ab2ec8f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:53.951702 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-aa8f757c-5e6b-4f11-a5dc-3c0f3012afbc req-7aa1f1de-3c6b-4e38-82df-b56c3ab2ec8f service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:53.969693 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-aa8f757c-5e6b-4f11-a5dc-3c0f3012afbc req-7aa1f1de-3c6b-4e38-82df-b56c3ab2ec8f service nova] Creating event network-vif-deleted:392d4826-ca87-4f90-8dc7-881f65216ff1 for instance 73f24893-2444-4657-8f7e-64d634c07212 on hv-cinder-78462 May 18 01:48:53.974608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:53.975450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:53.975578 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-aa8f757c-5e6b-4f11-a5dc-3c0f3012afbc req-7aa1f1de-3c6b-4e38-82df-b56c3ab2ec8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039611 May 18 01:48:53.976584 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 500/1043] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:48:53.984506 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:53.984956 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:53.985771 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:53.986228 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:54.205398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bebf6029be04af4922e46f0ae040327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0c3cb4d3634c8080132e61a0648e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:48:54.214788 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-defb0fd7-274d-4a9a-b529-59a43988a8c6 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 200 len: 1341 microversion: 2.1 time: 0.245996 May 18 01:48:54.215374 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 544/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:53 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 1341 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:48:55.233903 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:55.234549 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] [instance: 73f24893-2444-4657-8f7e-64d634c07212] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:48:55.246465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:55.246918 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:55.247692 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:48:55.248128 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:48:55.301004 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] HTTP exception thrown: Instance 73f24893-2444-4657-8f7e-64d634c07212 could not be found. May 18 01:48:55.301604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Returning 404 to user: Instance 73f24893-2444-4657-8f7e-64d634c07212 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:48:55.302428 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-7039141f-ace5-4185-a485-2f7b19afd4a5 tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212" status: 404 len: 111 microversion: 2.1 time: 0.073477 May 18 01:48:55.302980 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 501/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:48:55 2021] GET /compute/v2.1/servers/73f24893-2444-4657-8f7e-64d634c07212 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 01:48:55.310991 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-2eb94516-cfd8-404a-9176-5f5ba242038a tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] Calling method '.version_select at 0x7efcd9422430>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:48:55.328398 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-2eb94516-cfd8-404a-9176-5f5ba242038a tempest-TestMinimumBasicScenario-2000096423 tempest-TestMinimumBasicScenario-2000096423-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98014054" status: 202 len: 0 microversion: 2.1 time: 0.021019 May 18 01:48:55.328948 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 545/1046] 10.222.0.16 () {58 vars in 1266 bytes} [Tue May 18 01:48:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98014054 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 01:49:04.669806 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-863826251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457100581", "security_groups": [{"name": "tempest-secgroup-smoke-1203183692"}], "block_device_mapping_v2": [{"uuid": "2fa78be3-ea93-437c-80d6-6d4d45161d8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2192753-81de-4186-86a3-1e0d48f6a9fe"}]}} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:49:04.992345 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.network.neutron [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] validate_networks() for [('f2192753-81de-4186-86a3-1e0d48f6a9fe', None, None, None)] {{(pid=92948) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 18 01:49:05.758531 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 18 01:49:05.759122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image limits 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 18 01:49:05.759362 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Flavor pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 18 01:49:05.759773 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Image pref 0:0:0 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 18 01:49:05.760184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.virt.hardware [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 18 01:49:05.768924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:05.769376 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:05.770183 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:05.770618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:05.789533 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 18 01:49:05.795019 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.quota [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Getting quotas for user 257328ddbc2b426bbcc9450bea59c08f and project 85ca98bb7e3246a3885ab6ddcfa09337. Resources: {'instances', 'cores', 'ram'} {{(pid=92948) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 18 01:49:05.904009 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Going to run 1 instances... {{(pid=92948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 18 01:49:05.906141 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fa78be3-ea93-437c-80d6-6d4d45161d8d',volume_size=None,volume_type=None)] {{(pid=92948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 18 01:49:06.090887 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-55ddfdd0-fffb-49bd-b12b-0b0ab0417a09 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.422888 May 18 01:49:06.090887 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 502/1047] 10.222.0.16 () {60 vars in 1147 bytes} [Tue May 18 01:49:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 01:49:06.101519 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-d230a913-ebeb-4208-ae0a-4b05d2e9b7a9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:06.102728 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-d230a913-ebeb-4208-ae0a-4b05d2e9b7a9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:06.204453 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-d230a913-ebeb-4208-ae0a-4b05d2e9b7a9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:06.215031 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-d230a913-ebeb-4208-ae0a-4b05d2e9b7a9 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1093 microversion: 2.1 time: 0.117313 May 18 01:49:06.215795 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 546/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:06 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:07.233082 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:07.233730 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:07.242529 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:07.242989 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:07.243777 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:07.244217 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:07.372189 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:07.384828 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-349cb27e-a715-4d98-8d51-49d9dcf2020a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1191 microversion: 2.1 time: 0.155222 May 18 01:49:07.385604 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 503/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:07 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:08.402300 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:08.402913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:08.406265 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c9e1c69-049e-4137-ae2c-56e3e06e55f5] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 18 01:49:08.412025 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:08.412514 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:08.413293 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:08.413763 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:08.647492 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:08.655766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-98103067-8bf9-4b94-bc85-780782e9aedd tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.257150 May 18 01:49:08.656350 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 547/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:08 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:09.509867 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [req-e4c1757f-14c2-4e95-8086-d6f7e57baa37 req-1bcf5857-98c2-4e66-9844-66b853614f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b43d02-0393-4b0e-a2e6-16ceedfc92e9", "tag": "1ba9e56f-13b9-4a1e-9647-c65a1fdf9706"}]} {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:49:09.511714 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:49:09.511714 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: warnings.warn(msg) May 18 01:49:09.523794 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e4c1757f-14c2-4e95-8086-d6f7e57baa37 req-1bcf5857-98c2-4e66-9844-66b853614f43 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:09.524465 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [req-e4c1757f-14c2-4e95-8086-d6f7e57baa37 req-1bcf5857-98c2-4e66-9844-66b853614f43 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:09.542062 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.compute.server_external_events [req-e4c1757f-14c2-4e95-8086-d6f7e57baa37 req-1bcf5857-98c2-4e66-9844-66b853614f43 service nova] Creating event network-changed:1ba9e56f-13b9-4a1e-9647-c65a1fdf9706 for instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 on hv-cinder-78462 May 18 01:49:09.547025 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [req-e4c1757f-14c2-4e95-8086-d6f7e57baa37 req-1bcf5857-98c2-4e66-9844-66b853614f43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041995 May 18 01:49:09.547840 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 504/1051] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:49:09.672952 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:09.673568 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:09.694847 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:09.695326 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:09.696090 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:09.696550 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:09.732348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c9e1c69-049e-4137-ae2c-56e3e06e55f5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50060. May 18 01:49:09.897754 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:09.906404 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-c5e69c5e-ae00-4691-bc4f-22e3ae81cdc4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.237144 May 18 01:49:09.907219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 548/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:09 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:10.923478 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:10.924804 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:10.932127 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:10.932611 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:10.933389 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:10.933828 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:11.130021 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:11.138088 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-c6d3d38e-5262-4818-8fce-2e23260ce56a tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.218765 May 18 01:49:11.138663 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 505/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:10 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:49:12.154993 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:12.155621 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:12.163699 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:12.164154 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:12.164986 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:12.165430 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:12.359136 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:12.368807 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-08a80f5b-a3a5-492f-a106-3fa235509feb tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.217584 May 18 01:49:12.369380 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 549/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:12 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:13.385864 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:13.386482 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:13.394407 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:13.394852 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:13.395628 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:13.396091 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:13.592472 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:13.601555 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-d6ab0f3a-234b-494a-80c0-925e4e4663e3 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.219453 May 18 01:49:13.602122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 506/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:13 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:14.617923 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:14.618532 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:14.625721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:14.626183 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:14.626950 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:14.628245 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:14.909613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:14.917884 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-b0557629-92c3-4262-b84c-b083c9709757 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.303943 May 18 01:49:14.918450 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 550/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:14 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:15.934848 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:15.935383 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:15.943077 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:15.943543 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:15.944351 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:15.944801 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:16.137449 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:16.145530 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-67e7e3c5-7d0e-4510-8e62-cdc25577d5a8 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.214441 May 18 01:49:16.146095 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 507/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:15 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:17.162360 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:17.163032 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:17.170160 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:17.170644 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:17.171416 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:17.171851 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:17.378618 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:17.386830 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3969984a-0402-48cc-8d40-97a5864a13cf tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.228338 May 18 01:49:17.387397 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 551/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:17 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:18.404188 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:18.404831 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:18.412134 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:18.412613 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:18.413396 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:18.413834 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:18.606441 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:18.615187 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-0ed837ea-19a6-4aa0-8be3-bb99cee28d84 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.215037 May 18 01:49:18.615755 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 508/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:18 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:19.492466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-31821860-323a-4187-8d23-4273534d710b req-76a9d0bb-fe7c-4f3e-b609-9d9d4f80f06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b43d02-0393-4b0e-a2e6-16ceedfc92e9", "name": "network-vif-plugged", "status": "completed", "tag": "1ba9e56f-13b9-4a1e-9647-c65a1fdf9706"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:49:19.494124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:49:19.494124 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:49:19.502983 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-31821860-323a-4187-8d23-4273534d710b req-76a9d0bb-fe7c-4f3e-b609-9d9d4f80f06b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:19.503435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-31821860-323a-4187-8d23-4273534d710b req-76a9d0bb-fe7c-4f3e-b609-9d9d4f80f06b service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:19.518880 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-31821860-323a-4187-8d23-4273534d710b req-76a9d0bb-fe7c-4f3e-b609-9d9d4f80f06b service nova] Creating event network-vif-plugged:1ba9e56f-13b9-4a1e-9647-c65a1fdf9706 for instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 on hv-cinder-78462 May 18 01:49:19.524015 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-31821860-323a-4187-8d23-4273534d710b req-76a9d0bb-fe7c-4f3e-b609-9d9d4f80f06b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223342 May 18 01:49:19.524609 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 552/1060] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:49:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 01:49:19.633184 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:19.633829 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:19.640978 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:19.641429 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:19.642202 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:19.642651 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:19.839250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:19.848450 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-3d503f11-83f8-4a4c-8414-df53929cf618 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1265 microversion: 2.1 time: 0.219756 May 18 01:49:19.849010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 509/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:19 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:20.865413 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:20.866091 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:20.873628 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:20.874080 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:20.874845 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:20.875282 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:21.071163 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:21.079362 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-f4ee88a3-2c56-49c6-9496-b5fa29331bf7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1451 microversion: 2.1 time: 0.218753 May 18 01:49:21.079934 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 553/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:20 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1451 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:21.095400 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:49:21.096758 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:49:21.104250 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:21.104736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:21.105510 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:21.105947 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:21.302788 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:49:21.310924 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-476b1fbc-df74-482e-b020-a3598e9fa930 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1451 microversion: 2.1 time: 0.219151 May 18 01:49:21.311484 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 510/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:49:21 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1451 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:49:23.683978 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-46061c64-251e-444c-b7d8-869d8eba9e48 req-55fd19db-ee33-4ce7-94f6-43cd557c58e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b43d02-0393-4b0e-a2e6-16ceedfc92e9", "tag": "1ba9e56f-13b9-4a1e-9647-c65a1fdf9706"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:49:23.685513 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:49:23.685513 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:49:23.694523 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-46061c64-251e-444c-b7d8-869d8eba9e48 req-55fd19db-ee33-4ce7-94f6-43cd557c58e3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:49:23.694969 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-46061c64-251e-444c-b7d8-869d8eba9e48 req-55fd19db-ee33-4ce7-94f6-43cd557c58e3 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:49:23.711721 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-46061c64-251e-444c-b7d8-869d8eba9e48 req-55fd19db-ee33-4ce7-94f6-43cd557c58e3 service nova] Creating event network-changed:1ba9e56f-13b9-4a1e-9647-c65a1fdf9706 for instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 on hv-cinder-78462 May 18 01:49:23.717656 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-46061c64-251e-444c-b7d8-869d8eba9e48 req-55fd19db-ee33-4ce7-94f6-43cd557c58e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092876 May 18 01:49:23.718266 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 554/1064] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:49:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:50:51.597249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:51.603219 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-9cd4f5ca-4a79-4c5a-b06a-f7a2b79521b3 req-6cd09b37-39c6-4fa6-9ea4-7312d319f490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b43d02-0393-4b0e-a2e6-16ceedfc92e9", "tag": "1ba9e56f-13b9-4a1e-9647-c65a1fdf9706"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:50:51.603952 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:51.610564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:50:51.610564 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:50:51.612014 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:51.612508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:51.613297 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:51.613738 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:51.625553 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9cd4f5ca-4a79-4c5a-b06a-f7a2b79521b3 req-6cd09b37-39c6-4fa6-9ea4-7312d319f490 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:51.626188 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-9cd4f5ca-4a79-4c5a-b06a-f7a2b79521b3 req-6cd09b37-39c6-4fa6-9ea4-7312d319f490 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:51.643419 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-9cd4f5ca-4a79-4c5a-b06a-f7a2b79521b3 req-6cd09b37-39c6-4fa6-9ea4-7312d319f490 service nova] Creating event network-changed:1ba9e56f-13b9-4a1e-9647-c65a1fdf9706 for instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 on hv-cinder-78462 May 18 01:50:51.648348 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-9cd4f5ca-4a79-4c5a-b06a-f7a2b79521b3 req-6cd09b37-39c6-4fa6-9ea4-7312d319f490 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049195 May 18 01:50:51.651459 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 555/1065] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:50:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:50:51.677358 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:50:51.815092 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-49cd9be9-682b-4323-84a4-9f4fc91f4b5c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 204 len: 0 microversion: 2.1 time: 0.221418 May 18 01:50:51.815963 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 511/1066] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:50:51 2021] DELETE /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:50:51.825307 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:51.826319 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:51.833860 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:51.834317 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:51.835162 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:51.835608 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:52.079779 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:50:52.091166 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-10153d9a-841d-477c-a1b4-17f886238dd4 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1576 microversion: 2.1 time: 0.270552 May 18 01:50:52.096340 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 556/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:50:51 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:50:53.109155 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:53.109898 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:53.117109 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:53.118116 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:53.119115 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:53.119556 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:53.413951 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:50:53.423301 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1109b7b5-2167-4f61-9bda-c63ac756b3e2 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1457 microversion: 2.1 time: 0.318333 May 18 01:50:53.423959 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 512/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:50:53 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1457 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:50:54.202017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-acf83922-26eb-4572-8952-88accf9b120b req-d1abff6b-5b46-4df9-a4b8-ae977092809c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b43d02-0393-4b0e-a2e6-16ceedfc92e9", "name": "network-vif-deleted", "tag": "1ba9e56f-13b9-4a1e-9647-c65a1fdf9706"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:50:54.203756 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:50:54.203756 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:50:54.213421 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-acf83922-26eb-4572-8952-88accf9b120b req-d1abff6b-5b46-4df9-a4b8-ae977092809c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:54.213873 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-acf83922-26eb-4572-8952-88accf9b120b req-d1abff6b-5b46-4df9-a4b8-ae977092809c service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:54.232424 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-acf83922-26eb-4572-8952-88accf9b120b req-d1abff6b-5b46-4df9-a4b8-ae977092809c service nova] Creating event network-vif-deleted:1ba9e56f-13b9-4a1e-9647-c65a1fdf9706 for instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 on hv-cinder-78462 May 18 01:50:54.237386 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-acf83922-26eb-4572-8952-88accf9b120b req-d1abff6b-5b46-4df9-a4b8-ae977092809c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039025 May 18 01:50:54.238071 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 557/1069] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:50:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:50:54.440249 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:54.441023 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:54.449029 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:54.449489 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:54.450281 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:54.450724 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:54.568559 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:50:54.578614 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-50b22ef0-1f8d-4283-b4c8-02d06ca658b7 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 200 len: 1224 microversion: 2.1 time: 0.142181 May 18 01:50:54.579312 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 513/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:50:54 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:50:55.597153 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:55.598810 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 38b43d02-0393-4b0e-a2e6-16ceedfc92e9] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:55.605776 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:55.606225 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:55.607055 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:55.607495 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:55.656655 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] HTTP exception thrown: Instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 could not be found. May 18 01:50:55.657246 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Returning 404 to user: Instance 38b43d02-0393-4b0e-a2e6-16ceedfc92e9 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:50:55.658071 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-25593606-3b01-43b1-9a78-24ff9a0b003b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9" status: 404 len: 111 microversion: 2.1 time: 0.065098 May 18 01:50:55.658605 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 558/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:50:55 2021] GET /compute/v2.1/servers/38b43d02-0393-4b0e-a2e6-16ceedfc92e9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:50:56.353480 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:50:56.353693 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: Tue May 18 01:50:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:50:59.522658 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:59.523220 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:59.524698 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-7742b8f9-b4ae-441a-831b-aeba81d3ae5f req-724c009a-309e-47f3-8e24-3c5922b66b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb1c42d-d846-47fa-9375-7222a25ddd03", "tag": "d7302219-5c9c-406e-a03c-2e983e47736e"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:50:59.526382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:50:59.526382 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:50:59.531899 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:59.532488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:59.533397 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:59.534052 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:59.535540 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-7742b8f9-b4ae-441a-831b-aeba81d3ae5f req-724c009a-309e-47f3-8e24-3c5922b66b53 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:59.535990 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-7742b8f9-b4ae-441a-831b-aeba81d3ae5f req-724c009a-309e-47f3-8e24-3c5922b66b53 service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:59.552839 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-7742b8f9-b4ae-441a-831b-aeba81d3ae5f req-724c009a-309e-47f3-8e24-3c5922b66b53 service nova] Creating event network-changed:d7302219-5c9c-406e-a03c-2e983e47736e for instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 on hv-cinder-78462 May 18 01:50:59.558463 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-7742b8f9-b4ae-441a-831b-aeba81d3ae5f req-724c009a-309e-47f3-8e24-3c5922b66b53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 May 18 01:50:59.559269 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 559/1072] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:50:59.600508 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Going to try to terminate instance {{(pid=92948) delete /opt/stack/nova/nova/compute/api.py:2539}} May 18 01:50:59.730149 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-ca335b20-48ad-49ee-afd2-9528fe4cb446 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 204 len: 0 microversion: 2.1 time: 0.211396 May 18 01:50:59.732879 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 514/1073] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:50:59 2021] DELETE /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 01:50:59.739896 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:50:59.740620 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:50:59.748286 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:59.748766 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:59.749551 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:50:59.749987 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:50:59.996960 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.policy [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92949) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:51:00.005929 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3afab23a-edff-4cb2-81b8-87e5c10a807f tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1577 microversion: 2.1 time: 0.269983 May 18 01:51:00.006538 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 560/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:50:59 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:51:01.025137 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:01.025877 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:51:01.033143 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:01.033602 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:01.034377 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:01.034816 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:01.229421 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:51:01.238024 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-04d62819-79cc-4453-9171-b97b51c3d51c tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1459 microversion: 2.1 time: 0.217467 May 18 01:51:01.238595 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 515/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:51:01 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 01:51:02.015435 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [req-a2a2270e-13bb-4d98-89ab-eda6b5e70cb3 req-6fccbb98-e9e6-465e-be30-ed20f89314ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb1c42d-d846-47fa-9375-7222a25ddd03", "name": "network-vif-deleted", "tag": "d7302219-5c9c-406e-a03c-2e983e47736e"}]} {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 01:51:02.017148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 01:51:02.017148 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: warnings.warn(msg) May 18 01:51:02.025792 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a2a2270e-13bb-4d98-89ab-eda6b5e70cb3 req-6fccbb98-e9e6-465e-be30-ed20f89314ed service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:02.026239 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [req-a2a2270e-13bb-4d98-89ab-eda6b5e70cb3 req-6fccbb98-e9e6-465e-be30-ed20f89314ed service nova] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:02.042819 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.compute.server_external_events [req-a2a2270e-13bb-4d98-89ab-eda6b5e70cb3 req-6fccbb98-e9e6-465e-be30-ed20f89314ed service nova] Creating event network-vif-deleted:d7302219-5c9c-406e-a03c-2e983e47736e for instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 on hv-cinder-78462 May 18 01:51:02.047591 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [req-a2a2270e-13bb-4d98-89ab-eda6b5e70cb3 req-6fccbb98-e9e6-465e-be30-ed20f89314ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036053 May 18 01:51:02.048189 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 561/1076] 10.222.0.16 () {64 vars in 1318 bytes} [Tue May 18 01:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 01:51:02.255168 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:02.255835 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:51:02.263133 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:02.263634 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:02.264455 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:02.264894 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:02.384246 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.policy [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257328ddbc2b426bbcc9450bea59c08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ca98bb7e3246a3885ab6ddcfa09337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92948) authorize /opt/stack/nova/nova/policy.py:199}} May 18 01:51:02.392922 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a29d97bc-c987-4559-b8d9-4798e5d20f60 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 200 len: 1225 microversion: 2.1 time: 0.141608 May 18 01:51:02.393506 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 516/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:51:02 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 01:51:03.410411 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:03.411105 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 8eb1c42d-d846-47fa-9375-7222a25ddd03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:51:03.418613 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:03.419064 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:03.419834 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:03.420271 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:03.479927 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] HTTP exception thrown: Instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 could not be found. May 18 01:51:03.480566 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Returning 404 to user: Instance 8eb1c42d-d846-47fa-9375-7222a25ddd03 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:51:03.481466 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-3bf23d7d-2f3c-46da-bd54-d9bffbc38f92 tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03" status: 404 len: 111 microversion: 2.1 time: 0.075174 May 18 01:51:03.482017 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 562/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:51:03 2021] GET /compute/v2.1/servers/8eb1c42d-d846-47fa-9375-7222a25ddd03 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:51:04.214618 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:04.215119 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.compute.api [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92948) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:51:04.222498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:04.222948 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:04.223712 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:04.224144 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG oslo_concurrency.lockutils [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:04.273151 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.wsgi [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] HTTP exception thrown: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. May 18 01:51:04.273736 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Returning 404 to user: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. {{(pid=92948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:51:04.275122 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-a61aa366-3cbf-4466-8c79-84392ec2685b tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 404 len: 111 microversion: 2.1 time: 0.064941 May 18 01:51:04.275850 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 517/1079] 10.222.0.16 () {58 vars in 1239 bytes} [Tue May 18 01:51:04 2021] DELETE /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:51:04.283958 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '>' {{(pid=92949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:04.284619 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.compute.api [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [instance: 2c09f17e-cba4-4ef5-9feb-b13cee531b03] Fetching instance by UUID {{(pid=92949) get /opt/stack/nova/nova/compute/api.py:2790}} May 18 01:51:04.292588 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:04.293051 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:04.293828 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 18 01:51:04.294273 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG oslo_concurrency.lockutils [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Lock "899e9673-49ec-499d-b8c9-5083af1a0741" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 18 01:51:04.342893 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.wsgi [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] HTTP exception thrown: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. May 18 01:51:04.343495 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: DEBUG nova.api.openstack.wsgi [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Returning 404 to user: Instance 2c09f17e-cba4-4ef5-9feb-b13cee531b03 could not be found. {{(pid=92949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 18 01:51:04.344349 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO nova.api.openstack.requestlog [None req-a018bad9-30eb-44fc-88f6-bd3161074cca tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03" status: 404 len: 111 microversion: 2.1 time: 0.064093 May 18 01:51:04.344897 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: [pid: 92949|app: 0|req: 563/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Tue May 18 01:51:04 2021] GET /compute/v2.1/servers/2c09f17e-cba4-4ef5-9feb-b13cee531b03 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 01:51:05.782586 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: DEBUG nova.api.openstack.wsgi [None req-1039160a-f95a-40b2-9a96-207ebdff349d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] Calling method '.version_select at 0x7efcda091af0>' {{(pid=92948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 01:51:05.785975 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1039160a-f95a-40b2-9a96-207ebdff349d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [51001995-8d97-4bbc-b863-089d3568cf51] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 18 01:51:06.804094 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [None req-1039160a-f95a-40b2-9a96-207ebdff349d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] [51001995-8d97-4bbc-b863-089d3568cf51] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50194. May 18 01:51:06.823010 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO nova.api.openstack.requestlog [None req-1039160a-f95a-40b2-9a96-207ebdff349d tempest-TestVolumeBootPattern-388241042 tempest-TestVolumeBootPattern-388241042-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-457100581" status: 202 len: 0 microversion: 2.1 time: 1.045253 May 18 01:51:06.823582 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: [pid: 92948|app: 0|req: 518/1081] 10.222.0.16 () {58 vars in 1260 bytes} [Tue May 18 01:51:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-457100581 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 01:51:47.192658 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:51:47.193224 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: Tue May 18 01:51:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:53:27.098488 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:53:27.098981 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: Tue May 18 01:53:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:53:45.369049 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed May 18 01:53:49.713498 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:53:49.714165 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: Tue May 18 01:53:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:53:52.891913 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:53:52.892543 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: Tue May 18 01:53:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:55:56.371840 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 01:55:56.372493 dv-cinder-784623-9-iscsi devstack@n-api.service[92949]: Tue May 18 01:55:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 01:56:15.372962 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 18 01:56:15.373540 dv-cinder-784623-9-iscsi devstack@n-api.service[92948]: Tue May 18 01:56:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!